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PREFACE TO THE FIRST RUSSIAN EDITION 


This course of mathematical analysis is a text-book for students 
of mechanico-mathematical and physico-mathematical faculties ofour 
universities (and to some extent of pedagogical institutes as well) ; 
it is intended as the main text-book in the study ofa science which 
appears in the curriculum under the heading of mathematical 
analysis and which deals with the theory of limits, infinite series and 
differential calculus with simple applications of these subjects. The 
necessity for such a text-book arose as most of the text-books on 
mathematical analysis published in this country have not fully satisfied 
the above requirements. ‘Text-books which by their briefness and 
simplicity of treatment are within the reach of the average student 
are usually either obsolete or of lower scientific level than is required 
for the training of specialized-‘mathematicians; other text-books 
which keep on the modern level are usually very bulky and their 
contents reach far beyond the scope of the current curriculum so 
that the average first and second years students are unable to benefit 
by them. It was therefore necessary to write a text-book whose 
contents would only include the strict requirements of the current 
curriculum and which would, at the same time, fully conform to the 
modern scientific standard. 

In attempting to make this text-book as brief as possible, I have 
selected the minimum necessary material and avoided all slackness in 
treatment. On the other hand, to help the student as far as possible, only 
the minimum detail is given throughout this course. I have not used 
words sparingly while trying to explain the line of argumentation. 
The relationship among various concepts, theorems, problems and 
theories, their importance and method of application in the applied 
fields and industry, as well as many other points of mathematical 
analysis are, in many cases dealt here more comprehensively and 
systematically than is usually done in other more extensive text-books. 
I have tried to make the student ready to appreciate the introduc- 
tion of new concepts and construction of new theories and make him 
accept them naturally and inevitably. I think that it has been only 
thus possible to maintain the continuity of interest of the studentand 
make him absorb the subject in an informal manner. 


An experienced reader will probably find that the theory of 
limits has been discussed in its full detail in chapters II, Ili and IV. 
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This theory is traditionally presented to secondary school students on 
the XVIII century level ; university text-books mathematical analysis 
immediately give the modern treatment of the theory of limits with 
all the ¢’s and 8's, and this is often preceded by a chapter devoted 
to the general theory of real numbers—a subject which does not, in fact, 
belong to analysis but to the theory of numbers and the theory 
ofsets.. As a result, the student thinks that the new “university” 
treatment of limiting processes has nothing in common with those 
limits which he has known at school. In the second place—and this 
iseven more important—this method can rob the student of elements 
of mathematical analysis as a live, dynamic and dialectic science 
which find their place in the history of scientific development and 
which have even today many of their practical applications. These 
undesirable effects which I had occasion to observe in many instances 
during my career as ateacher prompted meto use in this text a com- 
pletely new system for treating the theory of limits. ‘This system essen- 
tially involves the following. At first (chapter II) the theory of limits 
is mainly based on anelementary but not a completely formal basis, 
and concepts like “‘process’’ or“‘moments’’ whichare not fully defined 
anywhere are systematically used. Only afterwards the necessity of 
formalisation has been emphasised, and the fundamental mathematical 
types of processes defined (chapter III). Then the attention of the 
student is drawn to the necessity of constructing a general theory of 
real numbers, and such a theory is, in fact, given in chaper IV. This 
method of treatment, which I had occasion to test three times in 
practice has the useful advantage that it creates in the mind of the 
student a gradual transition from the “‘school’’ theory of limits to its 
‘university’ treatment, and all stages of this treatment, are fully 
explained. At the same time it enables him to create at the begin- 
ning and maintain throughout the course the basic concepts of 
mathematical analysis as a live and dynamic subject and concentrate 
on the formally logical refinements of this subject, which is its due. 


So far as the general theory of real numbers is concerned, I 
have found it necessary to convince the reader of its significance and 
quote one of the possible principles explaining the existence of 
imaginary numbers (the limit of a monotone bounded sequence). 
Only then I have enumerated the basic problems which the theory 
has to deal (order in a continuum, definitions and rules of algebraic 
methods) ; at this point I have also given few examples of their 
solution, indicating briefly that the theory of numbers can be applied 
quite satisfactorily to. these problems and that, in future, we shall 
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deliberately use the results provided by this theory. The future 
mathematicians will be able to learn in other more detailed courses 
the fact that the theory of numbers can solve all these problems; this 
problem is hardly of any interest to the future mechanic, physicist, 
or astronomer. In any case, I do not consider it possible to 
attract the attention of a varied audience, either in my lectures or 
in this book, to the study of a large chapter the contents of which 
have no immediate connection with mathematical analysis. 


The further treatment of the subject follows, in its main out- 
lines, certain well defined methods. I am sorry to say that in editing 
the Jast three chapters (raultiple, curvilinear and surface integrals) 
my attempts to make the treatment absolutely formal and, at the 
same time, easily accessible did not meet with success, as far as I am 
able to judge. I could not avoid compromises by sacrificing either 
the formality or the briefness and accessibility of the arguments. If 
this course is received with favour, then it will undoubtedly be 
necessary to work further on these chapters in future editions. 


A few problems given in this course are valuable only as 
illustrations, but they are not intended as a method of instruction. 
The number and character of these problems correspond to what 
a lecturer can convey during his lectures. I had no intention of 
including the material for practical (group) lessons in this course of 
analysis. Obviously, anyone studying this book should simultan- 
eously use a good book for problems. For this purpose the recently 
published “Problem Book on Mathematical Analysis’ by B.P. 
Demidovich (Gostekhizdat, 1952) is particularly suitable. For the 
convenience of certain classes of readers I have indicated in many 
paragraphs a few problems appearing in the above book which I 
especially recommend. I must, however, warn the reader that 
these problems are, in a majority of cases, insufficient for acquiring 
the necessary skill ; a further choice of examples should be left to 
ihc teacher-in-charge of practical classes. 


A competent reader will readily note that the order in which 
individual subjects are treated in this book is in no way compulsory 
and can be easily altered in many instances ; for example 1!) some 
geometrical applications of differential calculus (chapter XXIII) can 
be given (and are, in fact, usually given) much earlier, and 2) the 
integral test for convergence of series niust not be postponed until 
the theory of generalised integrals is dealt with (chapter XV); but 
it can be given with the treatment of series of constant signs (chapter 
XVIII, § 68). 
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It is my pleasant duty to express my sincere and deep gratitude 
to my colleagues of the Faculty of Mathematical Analysis at the 
Moscow, Leningrad and Kiev Universities for their valuable help 
given by reading the manuscript (or its individual chapters) and for 
their remarks and suggestions which have mostly led to significant. 
improvement in the treatment of the subject. In this respect I am 
particularly grateful to Prof. L.A. Tumarin (Moscow) and Prof. 
G.E. Shilov (Kiev). Finally, I want to thank the editor of my 
book, O.N. Golovin, for his competent and considerable work 
devoted to this book ; his many valuable suggestions have helped. 
considerably to improve its contents. 


Moscow, 
24 February, 1953. A. KHINCHIN 


PREFACE TO THE SECOND RUSSIAN EDITION 


The second edition of this book is mainly printed from blocks, 
and corrections of many individual mistakes and errors have been 
done by the author; in some cases attempts have been made to- 
improve the treatment of the subject. In this respect I have been 
greatly helped by a detailed criticism of this book sent to me by the 
Faculty of Mathematical Analysis at the Rostov University (under 
the chairmanship of Prof. F.D. Gakhov); I am deeply grateful to all 
the members of this Faculty. Iam also very thankful to Academi- 
cian A.N. Kolmogorov and Prof. A.D. Myshkis (Minsk) for pointing 
out some mistakes. 


The ‘Problem Book on Mathematical Analysis’ by B.P. 
Demidovich which has been frequently referred in this book has. 
appeared in its second edition in 1954 with a fundamental revision 
of the numbering of problems. Jn the present edition of this course 
the numbering of all recommended exercises refer to the first edition 
of this “Problem Book.” 


Moscow, 
19 December, 1954. A. KHINCHIN 
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CHAPTER I 
FUNCTIONS 


§ 1. Variables 


The introduction of the variable was a decisive step in 
mathematics. Thus movement and dialectics were introduced in 
mathematics. (F. Engels, Dialecties of Nature, Gospolizdat, 1948, 
p. 208.) 


Elementary mathematics—the mathematics of constants— 
revolves, as it were, within limits of formal logics; the 
mathematics of variables, which is chiefly concerned with 
infinitely smal! quantities, essentially involves the application 
of dialectics to mathematical relationships. (Ff. Engels, Anti- 

During, Gospolizdat,, 1948, p. 127.) 

When we observe a natural phenomenon or the course of a 
technical process we can usually note the different behaviour of 
quantities involved in this phenomenon or process. Some quantities 
do not change in the course of the process, z.e. they remain “‘constant”’, 
while others are subjected to greater or lesser change—they become 
greater or smaller—z.e. they are “‘variable”. If we heat a gas con- 
fined in aclosed vessel its volume remains constant ; the number of 
molecules of the gas also remains constant ; on the other hand the tempe- 
rature of the gas, and its pressure will grow and become increasingly 
greater. The picture becomes even more varied if instead of considering 
this simple laboratory experiment we consider a complicated techni- 
cal process. Let usconsider, forexample, the flight of an aeroplane. 
Many different quantities are involved in this phenomenon. Some 
of these remain constant throughout the flight ; e.g. the number of 
passengers, the weight of their luggage, the span of the wings of the 
aeroplane, and: many others. However, this process also involves 
many other quantities which alter during the process by becoming 
greaterorsmaller. Such are, for example, the distance of the aeroplane 
from the point of departure and from its destination, its height above 

_the earth, the supply of fuel, the temperature, pressure and humidity 
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of the surrounding air, and many others. The above summary shows 
that these variable quantities are most important in economical and 
technical calculations connected with this process. This can readily 
be understood. Nature involves continuous changes and the practical 
life of man is directed towards changing his surroundings. For this 
reason processes in which nothing, or almost nothing, changes have 
little to offer scientifically and are of no practicalinterest. According 
to the dialectic principles of nature study, we should study not somuch 
the instantaneous aspect of phenomena but their changes in time ; 
from the dialectic point of view we are not so much interested in the 
given aspect of a phenomenon but in the general course of the pheno- 
menion, 7.e. we are interested how and what changes if this phono- 
menon took place from time to time. Mathematics, in as far as it 1s 
a real tool in nature study, should be able to provide an apparatus 
which would enable one to study systematically any changes in 
quantities which take place in nature and in technical processes. 


Mathematical analysis is such an apparatus and, in the widest 
sense of the word, can be called the mathematical science of variables. 


Hence the first basic concept in mathematical analysis is the 
variable quantity or, as it is usually said in mathematics, the concept 
of the variable. By this we niean quantities which acquire varying 
values; either greater or smaller, in the course of the given’ process ; 
at different stages of a given process the values of this quantity are, 
generally speaking, different. Without going into further details we 
know from everyday experience that the character and manner in 
which quantities change can follow a very diverse course ; some 
quantities increase continuously; other quantities, on the other hand, 
decrease continuously; still others change in a vibrating manner 
by first growing and then diminishing (the distance of the Earth from 
the Sun, the deflection of a pendulum from the vertical position) ; if 
we assume that the given quantity grows continuously, it can do so 
either very rapidly or very slowly, z.¢., the pace of its growth can become 
quicker or slower. Mathematical analysis in its widest sense en- 
ables us to study systematically these and other characteristic changes 
of quantities in our surroundings; it introduces a definite pattern 
into the enormous number of various types of changes and finds 
common laws which govern changes of various types. 


In mathematics every quantity involved in-a phenomenon, 
irrespective of whether it is a constant or a variable, is usually denoted 
by a single letter. Thus, for example, if a quantity is denoted by the 
letter x or by the letter a, then this fact by itself gives no indication as 
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to whether this quantity is a constant or a variable ; therefore the 
‘way in which this quantity changes must be stressed separately. 
Furthermore it is very important to keep in mind the fact that without 
the knowledge of the process (phenomenon) in hand, we cannot, gener- 
ally speaking, know whether this or another quantity is a constant or 
a variable, The same quantity can be a constant in one process and 
a variable in another process ; thus, for example, if we rotate a circle 
of radius r about a straight line without changing its radius (first 
process) then the area of this circle 7r* will be constant ; if, however, 
we keep the centre of the circle stationary and increase its radius 
(second process), then the area of the circle will grow, i.e. it will be 
a variable. 


In mathematical analysis the well-known geometrical represen- 
tation of numbers by points on a straight line (the so-called ‘‘number 
dine’) is widely used. Ifwe denote the origin by O anda unit of length 
on the straight line, then we can represent an arbitrary number « by 
a point at a distance | «| *from the point O) ina direction which 
‘depends on the sign of the number «& (generally, if the number line is 
horizontal, positive numbers are plotted to the right and negative 
numbers to the left of the point O). Every value of x is a number 
and can be represented by a point on the number line. If in the 
given process the value of # is constant then this value is denoted by 
one and the same point on the number line during the whole process, 
We can therefore say that a constant is represented by a stationary 
point on the number line. If, however, the value of # varies during 
the given process, then its values at different stages of the process are 
represented by different points on the number line; in the course of 
the process the point denoting the value of changes its position and 
we can therefore say that a variable is denoted by a mobile point on 
the number line. 


§2. Functions 


Quantities involved in the same phenomenon do not, as a rule, 
change independently of each other; usually these quantities are also 
more or less closely related to one another so that changes in one of 
these quantities involve corresponding changes in the other quantities. 
Thus, by increasing the radius of a circle we inevitably also increase 
its area; by compressing a gas confined in a vessel (t.e. by decreasing 
the volume occupied by the gas) we also (by keeping the temperature 
constant) inevitably increase the pressure of the gas; by adding 





*) The symbol | x | denotes the “absolute value of the number x.”’ 
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manure to the soil we hope to increase the yield of the harvest, etc. 
We can see from the above examples that quantities involved in the 
same phenomenon can bear to one another a more or less close re- 
lationship. This relationship is closest in the first example; by knowing 
the radius 7 of the circle we can determine its area s uniquely and 
with absolute accuracy according to the formula s == zr. In the 
second example the picture is somewhat different; by knowing the 
volume ¥ occupied by the gas and its absolute temperature 7’ we are 
able to determine uniquely its pressure / according to the well-known 


formula : 
Paes hes ee cT 


“p > 

where ¢ is‘a constant known from: physics; however this formula is 
only accurate with certain (in some cases rather rough) approxima- 
tions and for more accurate calculations it. is necessary to usé more 
complicated formulae which show that when determining the pres- 
sure .of the gas under real conditions it is insufficient to know its: 
temperature and volume alone, but it is also necessary to take some 
other quantities into account. This point is even better illustrated in 
our last example ; although it is true to say that the quantity of 
manure has an undisputed effect on the yield of the harvest it is 
nevertheless clear that from the knowledge of the quantity of manure 
used we are unable to forecast the yield of the harvest with any accu- 
racy, for the yield of the harvest, apart from the quantity of manure 
‘used, also depends on a series of other factors (for example on meteoro- 
logical and-agrotechnical factors of different kinds). 


It ‘is evident that mathematical analysis is mainly concerned 
with’ accurate relationships existing between quantities, i.e. from the 
knowledge of one: group’ of quantities we are able to determine 
uniquely and accurately the values of a certain other group of quanti- 
ties Consider, for example, the accurate relationship existing in the 


above formulae _ 
= > ee 
oie Se ea a 

where ¢ is a known constant. The value of the radius 7 of the circle 
is unique and defines accurately its area s. If we know the quantities 
f and v then the second of the above formulae enables us to deter- 
mine quite accurately the corresponding value of g. In the first 
case the value of s depends only on one quantity:r; each value of r 
corresponds to a definite value of s and every change in the value of 
r involves’ a corresponding change in the value of s. The second 
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example is more complicated ; in order to find the value of p it is not 
enough to know the value of 7' or the value of v alone; the value of p 
depends on the values of two quantities—T and v; we must know 
both values if we are to determine the value of f in accordance with 
our formula ; to each pair of values v and 7’ corresponds one value’ of 
fp and changes in the value of # depend on changes in the values of 
both 7 and v; as far as values of v and 7 are concerned changes in 
either of them are independent of one another and can take place in 
any way we like. In the physical sense this means that the given mass 
of gas can be confined in an arbitrary (within certain limits) volume 
v and can be heated to an arbitrary (within certain limits) tempera- 
ture 7. But as soon as we have chosen the values of v and 7 the 
pressure of the given mass of gas no longer remains arbitrary but is 
defined uniquely and quite accurately by our formula (we are, of 
course, omitting the fact that the formula itself requires corrections 
for real gases). 

The above examples are particular cases of the following gener al 
scheme. A quantity y involved in a certain process depends on the 
quantities x1, % 9, ...*z, which are also involved in the’same process ; 
this dependence is such that toeach set of values x), ¥», ..., *, Corres- 
ponds a single value of the quantity y; at the same ime the values 
of x1, ¥9) -.-, «% are independent of one another, i.e. by assuming the 
values of some of these quantities we can select the values of the 
remaining quantities quite arbitrarily (usually within certain set 
limits). This type of dependence of the value of » on the values of 
X15 Xo) +++) <p is known as functional dependence and _y is said to be the 
Junction of %1, Xo) +--+) %hj X 4) %o +++) 4 are, in this case, said to be 
independent variables. Hence in the above examples the value of s is a 
function of one independent variable r*) and the value of p is a 
function of two independent variables 7 and v. To begin with we 
shall concentrate on the simplest case when k = I, i.e. when » is a 
function of a single independent variable x. 


The fact that y isa function of the independent variable x is 
usually denoted as follows : y = f (x), ory = « (x), or y = A (x), ete. 
The letter in front of the bracket indicates the functional dependence 
of yonx andcan be selected arbitrarily—the meaning of this notation 
thereby remains unchanged. Thus the fact that the area of a circle 
is Ber determined by its radius can be written down in the form 
s = f(r), ors =s(r), ors = A(r), etc. Similarly the fact that y is a 





*) Frequently instead of using the words “of one” or “of two” it is simply 


said ‘‘one’’ or “‘two’’, etc. 
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function ofseveral independent variables x), x2, ... *% ean be written 
in the form of the relationship y = f (*1, %2, -.., *4%). ory = (*1, 
Xo, see) Xp), OF y = F (xy, Hq,..., %e), etc. Thus the fact that the 


pressure p of the given mass of gas is defined uniquely by the values. 
of its volume v and absolute temperature 7' can be written in the form 
p=fv, T), orp = p (v, T), or p.= Fv, T), etc. Hence the letter 
chosen to denote the functional dependence does not tell us anything 
about the nature of this dependence; the relationship y = f (x) can,. 
in different cases, mean that y = 3 x?, or y = log x, or y = sin x, 
etc. To avoid errors it is only important to see that in the same 
argument one and the same letter does not symbolise different types. 
of functional dependence. Thus if in a certain“process y = x? and 
Z = «3, then we cannot, of course, write y = f (x) and z =f (x).. 


On the other hand, in some cases one and the same letter is used 
to denote a certain quantity and a type of its functional dependence 
on other quantities [s = s (r) and y = y (xj, ..., *x) in the above 
examples]. 


The dialectic method of nature study and the study of technical 
processes requires that the quantities involved which ehange during 
the process should not be studied separately, irrespectively of each. 
other, but should be studied in the same interdependence in which 
they stand to one another inreality. ‘The mathematical interdepend- 
ence of real numbers is, in the simpler cases, expressed by the concept 
of functional dependence. It is therefore clear that if the first basic 
concept of mathematical analysis is the concept of the variable, as we 
saw in §1, then the second concept in the development of the science 
of variable quantities is the concept of the function. Furthermore 
the necessity of considering continually variable quantities and their 
interdependence, both from the scientific and the practical points of 
_view, has made the concept of the function the main object of study 
in mathematical analysis so that it is quite correct to call this science 
the general theory of functions. 


§ 3. The region of definition of a function 


We agreed to call y a function of x if, by assuming the value of 
“, the value of 7 is thereby defined uniquely. At the same time it is 
not necessary that y should be defined for every value of x; the real 
meaning of the values x and y and the problem in hand determine in 
every case the values of x which have to be considered. Thus, for 
example, if y denotes the area of a regular x-sided polygon inscribed. 
in a circle of unit radius, then evidently » is a function of x; but 
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from the nature of this problem it is obvious that we are only interes- 
ted in those values of x which are integers, e.g. 3, 4, 5,..., Similarly 
n‘is a function of x but, by its nature, it becomes devoid of meaning 
for all numbers other than the integers n > 0. Thefunction y = log x 
is usually only defined for positive values of x. 


If the absolute temperature 7’ of a certain body, given in 
degrees Centigrade, is the independent variable in a given problem, 
then, in all probability, we shall not be interested in temperatures 
below—273. On the other hand the functions y = x? or y = sin x, 
which are given in purely mathematical form, can be defined for all 
values of x and in practice one meets many such problems which can 
only be solved if we know how to determine the value of the function 
for every value of x. 


The above examples show clearly that the set of values of the 
independent variable x for which it is logical and necessary to deter- 
mine the corresponding values of the function » depends entirely on 
the nature of the problem in hand. In the choice of this set we are 
usually guided by mathematical, or sometimes practical, considera- 
tions. In any case whenever we deal with an arbitrary function 
y = f (x) we must keep clearly in mind the set M of those values of 
the independent variable x for which this function is defined and in 
cases where there is the slightest doubt it is necessary to mention 
clearly the appropriate set ; for values of x which do not belong to 
this set the function y is devoid of meaning and is considered to be 
an undefined function. Therefore the set Mis said to be the region 
of definition of the given function. 


In view of this it is clear that the set Af should be mentioned 
in the definition of a function : 


The quantity y is said to be a function of the quantity x defined by the 
set M if to every value of x which belongs to the set M there corresponds a 
definite value of y. 
$4, Functions and Formulae 


Whenever an arbitrary definite function is given in matlemati- 
cal form it is necessary to define the relationship which defines the 
corresponding value of y for every value of x belonging to the set M. 
The means of establishing this relationship are, of course, very impor- 
tant from the practical point of view; however, in principle this is 
only a technical problem of secondary importance. The most 
convenient method of defining the function y = f(x) is, of course a 
definition which states clearly the algebraic operations over x and the 


as 
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order in which they are to be performed so as to obtain the corres- 
ponding values of y; typical examples of this type of definition are 


simple formulae of the type_y = 3x*, » = xa ete, with the aid 


T+a 
of which it is easy to calculate the values of _y for every value of x; a 
similar case is provided by the formula 


plese 12 ty 


which defines the values of the function 2! for all positive integral 
values of the number n. 


However, it is not always possible to define a function in this 
simple form; and even when this is possible it is not always the most 
convenient way from a practical point of view. Even such elemen- 
tary functions as log x, sin x, cos x, etc., are given by formulae which 
do not give a simple answer to the question of how to find the corres- 
ponding value of the function from the given value of x. For exam- 
ple, the function y = sin x is usually defined by the well-known geome- 
trical representation; the latter convinces us of the existence of a 
unique, and fully defined function sin x, but it does not give us an imme- 
diate method for finding the values of this function. It is therefore 
necessary to solve this problem by a special method; the fact that the 
solution of this problem is not simple is obvious from the wide use of 
tables for functions like sin x, cos x, log x, etc.: in these tables the 
results of calculations of this or other functions for different values 
of x are given; these results, having once been obtained with 
considerable effort, are published in the form of tables in order to 
save scientists and practical workers the unnecessary repetition of 
calculations. 


Below we give a few good examples for defining functions. 


Example 1. Let » denote the greatest integer which does not 
exceed the number x; it is obvious that the value of y will thus be 
defined uniquely for every value of x, z.¢. it is defined asa function 
of x. This function is usually denoted by the symbol [x] so that, for 
example 

[2.5] = 2, [5] = 35 [7] = 3, [= m]= —4 


etc. The function y = [x] is of great importance in the theory of 
numbers and in other branches of mathematics. We can see that it 
can be defined very simply, but it contains no formulae to indicate 
the sequence of operations which have to be performed in order to 
arrive from the given value of x to the corresponding value of y = [x]. 
By the way, it is also possible to express the function y == [x] in terms 
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-of x by means of a “formula’’, i.e. by means of a series of symbols 
used in elementary mathematics ; however, such a formula would, as 
a rule, not facilitate in any way the investigation of the function [x] 
and it is therefore more natural to use its definition without a 
formula. 


The quantity x — [x] is said to be a fractional pari of the number 
x and is rather important in the theory of numbers; it is evident 
that this is a periodical function with a unit period, so that we have 


0<x—[k] <1. 


Example 2. (‘‘Dirichlet’s function’’?). Assume that D (x) = 1 
when « is a rational number (i e¢. an integer ora fraction) and D (x) = 0 
when 2 is an irrational number (for example x = «1/2 or x = 7). 
The function D (x) is defined for all values of x (its region of defintion 
is the whole number line). We can see that its definition is very sim- 
ple. In order to find the value of D (x) from the given value of x it 
is only necessary to establish by any arbitrary method whether « isa 
rational or irrational number; no general method can be given for 
this purpose—the solution of this problem depends on the way in 
which x is given; numbers x exist in mathematics which can be 
- accurately defined but which have so far not been defined as rational 
or irrational numbers; this means that certain values of the function 
D (x) cannot be evaluated mathematically, but in spite of this the 
. above definition of the function D (x) is quite valid. A “formula” 
- can also be written for the function D (x), i.e. it is possible to express 
it in terms of mathematical symbols in general use. However, such 
.a formula has no practical value since the main properties of Dirich- 
let’s function can usually be deduced much more easily from the 
“‘formulaless” definition given above, whereas with the aid of a for- 
mula they cannot be deduced at all or can only be deduced with 
great difficulty. 


The above examples clearly indicate the part played by a for- 
mula in analytical expression and in the definition of functional 
dependence. A formula, when it is simple and convenient for calcu- 
lations and investigations, can be an invaluable tool in the study and 
practical application of the given function. However, in cases where 
a formula cannot be found or where an existing formula is compli- 
- cated and gives little information, there is no good reason for making 
.a formula the focal point in the study of a function; in many cases 
“formulaless” investigations are simpler and more productive. 


For a long time (during the whole of the XVIII and the begin- 
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ning of the XIX centuries) the concept of the function was closely 
linked with a definite analytical expression which, from a useful 
method in the study of functions, became its exclusive master. ‘This 
tendency, which is purely formal in character (for the form is the- 
analytical expression and through it the real laws of functional 
dependence were dictated) was obstinately maintained for many 
centuries and even today it is not quite obsolete, especially in the.- 
applied sciences. A change in outlook, as described in $3, took 
place when the definition of the concept of functional dependence - 
became divorced from outside influences; this happened in the 
middle of the XIX century and is connected with the name of the 
German mathematician Dirichlet. However, several years before - 
Dirichlet the Russian scientist N. I. Lobachevskij proposed this - 
definition with great clarity. *) In order to distinguish between the - 
formal and the other approach to the definition of the concept of a 
function and to clarify it still further we give below one more - 
example. 


Example 3. Let us assume that 


—1—x? (x <0), 
safle = 0 {x = 0), 
1+." (x > 0). 


This means that for negative- 
values of x» we must calculate y by 
the formula » = — 1] — x, and for > 
positive values of x—by the formula 
y=l+x?; when x0 we have y= 0. 
It follows from our definition that we - 
evidently have here a single function . 
which is defined for all values of x (its . 
region of definition is the whole num- 
ber line). The graphical representa- 
tion of this function is given in Fig. 1. 






aA 


Fig. 1, 


During different stages of the process our function is evaluated ° 
with the aid of different formulae; this circumstance has no special 
significance from the point of view of the definition of our function; 
it does not alter the fact that irrespective of the value of x there is 
only one definite corresponding value of_y; this is sufficient to con- 
vince us that we are dealing with a single definite function. The - 





*) Several years earlier the same idea occurred to the Czechoslovakian - 
mathematician Bolzano. 
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formal point of view, however, connects every function with a definite: 
analytical expression and one would therefore be tempted to say that 
y is expressed by “different functions” during different stages of the 
process. 


The history of the development of functions and the practical 
applications of this science have proved without doubt the advantages 
of the former point of view which has liberated the concept of the 
function from the burden of a formula as compared to the formal 
concept which attempts to subject the function to a definite outward. 
form of expression. 


Apart from general methodical and logical points of view,,. 
this advantage is further based on the fact that functions similar to 
the function just defined (?.e. a function which can be expressed by 
different formulae during different stages in the process of change of 
the independent variable) occur quite often in nature and technical 
problems (particularly in physics, chemistry, thermodynamics, etc.).. 


§ 5. The geometrical representation of functions 


The basic principles in the geometrical representation of 
functions (the construction of graphs) are studied in secondary schools 
and we shall here only make a few short remarks in connection with 
this problem. 


By the graph of the given function f(x), we understand a. 
geometric set of points in a plane, the rectangular co-ordinates x and 
y of which are connected by the relationship y = f(x). If the function. 
J (x) is not unduly complicated then its graph usually represents a. 
more or less straight line in the plane. ‘The fact that each value of x 
(within the region of definition of the given function) corresponds to- 
a unique value of y = f(x) can be illustrated very simply by geome-. 
trical means: every straight line which is parallel to the OY-axis 
intersects the graph of the function f(x) only at one point. Other 
curves which do not possess this property cannot, generally speaking, 
serve as the graph of any function of the variable x; on the other 
hand, every curve possessing this property is, evidently, the graph of 
a function, for every unique dependence of y on x does, according’ 
to the definition of the concept of a function, represent a certain 
functional dependence. 


The geometrical representation of functions is very important 
in their study and is therefore a very useful tool in mathematical 


42 A COURSE OF MATHEMATICAL ANALYSIS 


analysis and its applications. From the graph of a function we are 
frequently able to see directly certain characteristics which could 
‘otherwise only be revealed by means of lengthy and complicated 
calculations—by studying the analytical expression or the compiled 
tables for the given function. / 


Fig. 2 thus shows that the function f(x) it represents grows 
“(when x increases) along the sections a, a3 and a, a5 and decreases 
along the sections a; @, and 43 a4; to obtain more detailed informa- 
‘tion, for example, about the way in which the function decreases 
along the section a, a2, we cansee directly from the graph that at the 
beginning (near x = a) the decrease takes place slowly, but later on 
it goes rapidly (the steep descent); the function decreases even more 
rapidly along the section a3 a,; while the increase of this function 
is rapid along a,a3 and much slower along the section a4 a5. 
‘Within the region under investigation this function reaches its 
‘maximum value at the point x = a, and its minimum value at the 
point x = a4. We can see clearly from the graph where the function 
is positive and where it is negative, etc. All this information about 
the function could only be obtained with much greater difficulty if 


instead of the graph we had used tables or the analytical expressions 
of this function. 


Y 





Fig. 2. 


The close relationship created by the geometrical representation 
of the function between the objects of analysis under investigation 
(functions) and the geometrical objects (curves) enables one not only to 
use visual representation in the study of the properties of this or 
-other function but, conversely, to use the numerous methods of mathe- 
matical analysis for the study of the geometrical properties of this or 
other curve and, moreover, a series of general geometrical propositions 
can be established in this way. In future we shall meet many ex- 
amples of this kind. The connection between analysis and geometry, 
the first step in which is the principle of geometrical representation of 
functions, is thus most useful for both mathematical sciences. 
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§ 6. Elementary functions 


In the historical development of the science of functional depen- 
dence a small group of functions was isolated from the endless. 
variety of different types ; these functions occurred frequently in. 
various problems and thus came to be subjected to detailed study. 
These functions are the so-called elementary functions. Further stu-- 
dies in the development of analysis acquainted scientists with many 
other more complicated functions which required just as much. 
attention ; nevertheless even today elementary functions are the basis 
in the many applications of analysis ; moreover, in the study of other 
more complicated functional dependencies we do, as a rule, use the- 
well-known properties of this classical group of elementary functions. 
This group basically coincides with the set of functions which are- 
usually studied in secondary schools ; therefore there is no need for. 
us to consider the properties of elementary functions here in greater — 
detail ; we shall simply enumerate them and make a few remarks in. 
each case. Some special characteristics of these functions are con- 
sidered later (§ 24). Elementary functions cannot be isolated as a 
group by any particular property and, as we have already said above, . 
this small group of functions came to be isolated in the historical 
development of this science as a natural basis in the study of other 
more complicated functional dependencies both for the purpose of 
analysis and for its applications. 


1. Polynomials, The.simplest form of functional dependence 
is provided by an arbitrary polynomial 


eS Ag kh ay 68 pb ag 88 be baat + aa 


where x is the independent variable, m is an arbitrary natural’ 
number and dg, @},..-, @n are constants (the “‘coeflicients” of the poly- 
nomial). To obtain the values of y for the given value of x we must 
perform over x and over the constants a series of arithmetical opera- 
tions (additions, subtractions, multiplications and raising to integral 
positive powers). Conversely, the result of a series of such operations 
over x and arbitrary constants can be represented by a polynomial. 
Therefore polynomials are also known by the name of rational integral 
functions; they are known as integral because the operations we 
enumerated above do not include division, and rational because these 
operations do not include the extraction of roots. Polynomials are 
the simplest example of functional dependence, because they’ can be - 
evaluated with the aid of the simplest -arithmetical operations ; there- 
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fore in the study of more complicated functions attempts are often 
made to represent them, if only approximately, by polynomials ; we 
shall deal with this aspect in greater detail later. 


2. Rational functions. If division is added to the arithmetical 
operations performed over x and the constants which we discussed 
above, then we obtain as a result an arbitrary rational (generally not an 
integral) function of x. As an example consider the functions 


1 1 _ x? 


pe sea ae PS eH 
etc. It can be proved by elementary algebra that every rational 
function can be represented as a relationship of two polynomials, 7.e. 
in the form 
P (x) 

= Se 1 

PO ay? (1) 
where P (x) and Q (x) are polynomials. Rational functions, like 
polynomials, can easily be evaluated for every value of the inde- 
pendent variable x except for those values of x for which Q (x)=0 in 
formula (1) ; for these latter values of x the rational function, as given 
by formula (1), remains indefinite ; these values correspond to values 
of x which lie outside the “region of definition” of the function y 
in accordance with the definition of a region given in $3 ; thus if y is 


given by the formula 


_ 1 
ae are 





then its region of definition will be the whole number line with the 
exception of the pointsx=Il and « = — 1. 


3. General power functions. By this name the following. 
function is known 
Dae ae 
where « is anarbitraryconstant. The nature of this function obviously 
depends on the arithmetical nature of a If « is an integer then y 
isa rational function (it is inetgral when « > 0). Whencisarational 


fraction, ¢ g. « = p/g (where # and g are integers and we can always 
assume that g > 0) then 


pie eae 

x xd = /xp 
is an trrational algebraic function of x (for the operations performed 
-over & include the extraction of a root of an arbitrary degree q). 
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The values of this function can no longer be evaluated as simply as 
those of a rational function. This is even more true in the case when 
« is an irrational number (7.e. for example the function y = x¥® or 
y == x™); strictly speaking we do not know how to determine such 


functions ; we shall return to this question in §§17 and 24. 


The region of definition of the function given by the formula 
y = x“ depends on the nature of the number a. If « is a positive 
integer then the whole number line serves as its region of definition ; 
but when « is a negative integer or zero, 1.¢. « < 0, the point x = 0 
must be excluded from this line. Ifo = 1/g, where q is a positive 
integer, then the function will be determined for all values of x 
when gq is odd, and only for x > 0, when gis even. The reader will] 
be able to determine for himself the region of definition of the 
function x* when « = p/¢, where f and q are integers. In cases where 
« is irrational, its region of definition is the semi-straight line « > 0, 
as we shall learn in § 17. 


4. Exponential functions. By this name the following function 
is known 


y= a", 
where a is a constant positive number. We shall learn in $17 that 
the whole number line serves as the region of definition of this 
function. We shall learn later some other important properties of 
this function. The value of y for the, given value of x cannot, in this 
case, be obtained by means of any known finite sequence of opera- 
tions (with the exception of the trivial case when a = 1); the func- 
tion a7 is not an algebraic function but a transcendental function *). 


ry 





*) Strictly speaking the problem is as follows : If the function y = f (x) of the 
independent variable x is obtained after performing a finite number of algebraic 
operations, as proved in algebra, then a polynomial P (x, y) of two variables exists 
so that, identically (i.e. for any x) P [x, f (x)] = 0. The converse proposition is not 
true; it may happen that the polynomial P does exist, but the function / (x) cannot 
be expressed in terms of x by means of a finite number of algebraic opcrations. 
It is customary to call the function f(x) an algebraic function if a polynomial P 
‘exists for this function which possesses the properties mentioned above. Hence the 
‘class of algebraic function is wider than thc class of functions which can be 
vexpressed in terms of a finitc number of algebraic operations. Every non- 
.algebraic function is known as a transcendental function. The functions a*, log , x 
(for every a > 0,4 x 1), sin a, Cos x, arc SiN x, arc cos x, ctc. are examples of trans~ 
»ecndental functions. 
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5. Logarithmic functions. The function 
J = logax, 

where a is a constant positive number other than unity, is defined as 
the inverse of the exponential function. This means that it follows 
from y = log,x that x = a”. To be more exact this means that for 
every x > 0, a single number y exists which satisfies the relationship 
a¥ = x; this number » is known as the logarithm of x of the base (or 
to the base) a and is denotedas log,x. Like the exponential function. 
the logarithmic function is also a transcendental function ; apart from 
its great theoretical importance it is also very important in calcula- 
tions; its significance is mainly due to the basic property of this. 
function: log, (#8) = logg« + log,B. The region of definition of 
a logarithmic function of any base is the semi-straight line x > 0. 


6. Simpler trigonometrical functions. These functions are the. 
following functions which are well-known from the school course of 
trigonometry. 

= sin x, ) = COS x, y = tanx, 
y = cotx, y = secx, y = cosec x. 


The chief property of these functions is their periodicity; tan x and. 
cot x have a period x and the remaining four functions a period 27. 
The whole number line serves as the region of definition of the func-- 
tions sin x and cos x; the functions tan x and sec x are defined se 
where except at points of the type 


r+ He 


and the functions cot # and cosec x—everywhere except at points of the 


type 
yok, 


where & in both cases denotes ‘an arbitrary integer. 


7. Inverse trigonometrical functions. Generally speaking, the 
function « (x) is said to be the inverse of the given function f(x) iff 
it follows from y = « (x) that x = f(y). We have seen already 
that the function log,x is the inverse of the function 2%. In this. 
case the inverse function is unique. However it is quite possible: 
for a given function to have several inverse functions; thus the func- 
tion x? evidently has the following inverse functions: + ./ x and’ 
— V%, for it follows equally from y = -+ +/x andfrom y = — 1/ x: 
that x = y®. It is a well-known fact that each one of the simpler: 
trigonometrical functions has an infinite number of inverse functions ;: 
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these functions are known as inverse trigonometrical functions. Let us 
consider, for example, the family of functions inverse to the sine. 
If « is an arbitrary number confined between — | and + 1, then an 
infinite number of values of x exists for which sin x = «; in particular 
one such value of « can be found between — a/2 and + =/2; it is 
denoted by sin“! a, so that 
oe, egret es, in (sin— «) = «: 
7 Ssnm™ eas sin (sin~? «) = «; 
it is obvious that the function sin-! x is the inverse of the function 
sin x; sin~* « is one of the angles whose sine is equal to «; but in such 


cases, as we know from trigonometry, the general form of an arc, the 
sine of which is equal to «, is as follows: 


(— 1) sina + ka, 
where £ is an arbitrary integer. Hence each one of the functions 
(— 1)* sin x + kx, 
where & is an arbitrary integer, is a function inverse to the function 
sinx. The region of definition of all these functions is the line 


— 1<x* <1. Functions which are the inverse of other simple 
trigonometrical functions are analysed and defined in a similar way. 


The functions considered in sections 1 to 7 include all the simple 
elementary functions. Other elementary functions are obtained 
from the simple functions either by means of algebraic operations 


[ »= = y = 2* (cos x — 2 sin a) |, 
or by “superimposition” of functional operations 
us 
- =logcosx, y= tan(l1+ 2”) i 


which means that a certain function of the independent variable is 
first taken, and then another function of this function is taken, etc. 
As a result of any number of operations of this kind, performed in 
any order in which the simple elementary functions serve as a basis, 
all elementary functions are obtained. We have already said above 
that we shall study most of the properties of elementary functions later 
on. Here, as a preliminary revicw, we have dealt with only a few 
simple functions. 


CHAPTER !1 
ELEMENTARY THEORY OF LIMITS 


§ 7. Infinitesimal Quantities 


Variable quantities which we meet in natural phenomena and 
in technical processes vary in very diverse ways. If we were to 
begin the study of the various modes of change, one after another, 
in the order in which we meet them in our practical experiences or 
in our nature studies, then this would be an unscientific approach to 
the problem. A botanist does not study all species of plants which 
happen to catch his eye, but begins by classifying his material, divid- 
ing it into groups which resemble each other more or less closely, 
and only then proceeds with the study of each class of plants as a 
whole; similarly the mathematician should try to divide all possible 
types of changes in quantities into more or less extensive classes so as 
to be able to analyse systematically all the properties which members 
of a given class have in common. In doing this he always begins 
with the study of the simpler objects, because in the first place, he 
learns by experience that the simpler objects of science are, in the 
majority of cases, of utmost importance in its applications and 
secondly, it frequently happens in mathematics, that after the 
simpler cases.have been studied, it is possible to break down the more 
complicated cases to these simple cases and to study them quickly 
and easily. Thus, when studying equations in algebra we begin 
with the simplest case, i.e. with equations of the first degree with 
one unknown; this type of equation is most common and more 
complicated cases can often be broken down to this case. 


The history of development of our science has shown that the 
simplest and the most important type of variable quantities that can 
subsequently be used in the study of many other quantities, which 
undergo more complicated changes, are the so-called infinitesimal 
quantities. The leading role of quantities of this type, both in 
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mathematical theory and in its practical applications is so great that 
the whole science of changing quantities is even today known by the 
name of “‘the analysis of infinitesimal quantities” or ‘‘the calculus of 


infinitesimal quantities’. We therefore begin our study of variables 
with this type of changes. 


Imagine a natural phenomenon, or a technical process in which 
a certain variable quantity x participates. Generally speaking, in 
the course of a process, x will increase sometimes and decrease at 
others. Let us now assume that the absolute value of x remains infinitesimal 
‘during the whole process. Let us explain in greater detail what this 
‘means. Let us assume that we are given a small positive number, for 
example 0'001. From a certain moment of the process onwards we 
‘shall always have |x| < 0001. Assume that weare notsatisfied with 
this degree of smallness and that we want to have | «| < 0000001. 
In order to achieve this we shall have, generally speaking, to advance 
the process to a further stage. But from a certain moment onwards 
we shall always have | x| < 0°000001. In general, irrespective of 
the infinitesimal quantity ¢ which we might choose, we shall sooner 
-or later reach a moment in our process when | x} < always. 





The quantitv x, the changes in which (in the given process) 
display the property described above, is known as an infinitesimal 


quantity (in the given process). Hence we arrive at the following 
definition : 


The quantity x is said to be infinitesimal (in the given process) if an 
arbitrary constant positive number ¢ is such that from a certain moment of the 
- process onwards it will always remain <. 


Example 1. When the temperature is maintained at a constant 


level, the pressure p o the given mass of gas is inversely proportional 
to its volume y, 7.¢., 


po Sy (1) 


-where ¢ is a positive constant. If we increase the volume of the gas 
indefinitely, then its pressure decreases; if the process)is continued 
for a long time, 7.e. the volurne of the gas is sutliciently large, then 
the pressure Of the gas, as can be seen from formula (1), becomes 
(and when the gas expands further, remains) as small as we please. 
This means that in the process of the unlimited expansion of the 
-given mass of gas its pressure is an infinitesimal quantity. 


Example 2. According to the law of gravitation the sun § 
-attracts the comet A which revolves round it (Fig. 3) with a force 
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-~, where é is a positive constant and 7 is the distance between the 


centres of the two heavenly bodies. Let us assume that we are dealing 
with a comet which only once appears within the reach of the solar 
system (hyperbolic orbit), after which it retracts indefinitely from it, 
2.e. the distance r increases indefinitely after the comet has revolved 
round the sun. It then becomes evident that the force of attraction: 


= becomes infinitesimal ; no matter how small the positive number 


we choose, this force of attraction will become in the course of this 
process smaller than ¢ (and will remain so for ever, i.e. when the 
comet has retracted from the sun for a. 


/ sufficiently great distance). ‘This means. 
that the force with which the sun attracts. 
} the comet becomes an infinitesimal quan- 
tity in the course of the infinite retrac- 
/ : tion of the comet. 
> peers a Example 3. In the geometrical pro- 
| \ 5 oa gression. 
A ee 
Se 1 1 1 1 


2 5] 4a Reger aes an pg tee 
the n’th term will be as small as we please, 
provided 7 is sufficiently great. This means that as n increases. 


Fig. 3 


‘ . l ha: fein tet ek 
indefinitely, an becomes infinitesimal. 


In general, if 0 << « < J, then (1 — a)" is an infinitesimak 
quantity when n increases indefinitely. In fact from 
(L—«)( 1 +a) =1--a% <1], 
it follows that 





1 ] 
eon L+a’ 


and therefore, when x > 0, 

1 

| eS ar 

but (1 +4)" > 1 + na, ascanreadily be seen by expanding (1 + «)” 
by the binomial formula (or by proving it simply by the full method of 
induction) ; therefore, the quantity (1 4- «)” becomes as large as we 
please, provided is sufficiently large. On the other hand, we can. 
see from our inequality that the quantity (1 — «)" becomes as small. 
as we please, provided n is sufficiently large, which had to be proved. 


ELEMENTARY THEORY OF LIMITS 21 


Example 4. Fig. 4 represents part of the usual trigonometrical 
circle of unit radius, so that 


AD = DC =|sinx}, arc 4B = arc BC = | x]. 


The straight line ADC is shorter than the arc ABC, i.e. 2|sin x| <2] x]. 
Therefore, by decreasing the absolute value of the angle x, we can 
make the absolute value of the sine as small as we please. This means 
that in the process of infinitely diminishing the absolute value of 
an angle, its sine becomes an infinitesimal quantity. This example 
differs from the preceding example by the fact that sin x can be. 
both positive and negative; irrespective of this it is an infinitesi- 
mal quantity, for according to the defini- 
tion of aninfinitesimal quantity, this type 
of change is connected only with the 
absolute value of the quantity. 


Example 5. The deflection of the pen- 
dulum from the vertical position in Fig. 5 
is measured by the angle @; it is conveni- 
ent to regard this angle as positive when 
deflection occurs to one side (for example, 
to the right), and as negative when deflec- 
tion is to the other (to the left). If the pendulum is left to itself 


(i.e. when its movement isnot supported bya spring or weight), then as 
a result of the friction of the mechanism and the resistance of the air, 
its amplitude of vibration will continuously decrease. In course 
of this movement the quantity @ becomes both positive and negative 
and passes through the zero position each time there is a change of 
sign. The graph showing the dependence of the angle @ on the time ¢ is 
schematically represented in Fig. 6 (curve of damped oscillattions). In 
course of time the height of the waves drops conti- 
nuously, which indicatesa gradual diminution in the 
amplitude of vibrations. No matter how small the 
positive number ¢, sooner or later a moment will be 
reached when | @| < ec always. This means that in 
the phenomenon under consideration the angle @ is an 
infinitesimal quantity. We are dealing here with an 
infinitesimal quantity which changes by acquiring 
alternately positive and negative values. 








Fig. 5 


If the vibration of the pendulum is supported 
by certain means with the constant expenditure of a form of energy 
{for example, by using an unwinding spring ordescending weight), 
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then the dependence of the angle @ on time will have the form repre- 
sented in Fig. 7 (curve of undamped oscillations). In this case the angle 
6 will no longer be an infinitesimal quantity; it is true to say that 
in course of time | @| becomes an infinitesimal quantity (or even 
zero); however, no matterhow long we wait,, we shall never reach 
the moment after which we shall always have | @| <4, where « is- 
the amplitude of (the undamped) vibrations ofthe pendulum. 


A comparison of the examples shows that infinitesimal quantities 
can have many d.iverse modes of change ; nevertheless their inclusion 
in a single clase presents, as we shall see on many occasions later on, 
a very conveuient method of investigation. 


8 


Fig. 6 


Note. The term ‘“‘infinitesimal quantity’? has been so well- 
established historically that it is very difficult to replace it by any other 
term without causing chaos in scientific terminology. However, this 
term is rather unfortunate and from the pedagogical point of view it 
conceals a danger about which the student must be warned. The 
word “infinitesimal? sounds as if it were intended to indicate the 
dimension of the quantity in question and the student frequently: 
connects the term “‘infinitesimal’’ with the concept of a “very small’” 
quantity or a ‘‘negligible quantity’’. This is quite incorrect The term - 
‘infinitesimal’ describes, by its definition, not the dimensions: of a 
quantity, but the character of its change. It would, of course, be more 
correct to call such quantities not “infinitesimal” but “indefinitely 
decreasing.” 
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$ 8. Operations with Infinitesimal Quantities 


The wide application of infinitesimal quantities to changes 
occurring in the world is made considerably easier by the fact that as 
a result of the simpler algebraic operations with infinitesimal 
quantities, other infinitesimal quantities are obtained. We shall now 
formulate this property in several simple theorems. 


Theorem 1. The algebraic sum of a constant number of infinitesimal 
quantities is an infinitesimal quantity. 


Proof. Lets =v, + x. +... Wn, where x1, V9, ...,%» are 
infinitesimal quantities and the number n is a constant. It is to be 
proved that the quantity s is infinitesimal. 


Let ¢ be an arbitrary positive number; in that case the number 
¢/nwill also be positive and constant. Since x, is an infinitesimal 
quantity, we shall reacha mounent in our process after which we shall 
always have 


piss 


the sanie applies to +. which is also an infinitesimal quantity and 
will also, in the course of the process, reach a point after which we 
shall always have 


pig RS 4 


=z[o 


the same also applies to +3, V4, ....%n. Hence the absolute value of 
every term of the sum s sooner or later reaches a moment after which 
it always remains smaller than </n; the moments when this inequa- 
lity is reached will, generally speaking, vary for different terms. 
However the number of these moments is equal to the number of 
terms n and among them the /atest moment can be found; from this 
latest moment onwards all the n inequalities will always be satisfied : 

€ € 


| Xe <a ey [tal < > 


<- 


xy |e 





"1 


and therefore, the inequality obtained as a result of term-to-term 
addition will also be satisfied 


eae |ael tn tlea| <n ae, 
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and therefore,” ) 


lei= [Pao <)) «| <e. 


kz=1 k=1 





We have thus shown that no matter how small the positive 
number € is,a point will be reached in the process after which we shall 
always have|s|<e. This means that s is an infinitesimal quantity. 
Theorem 1 is thus proved. 


In order to prove the other theorems we must introduce one 
more concept, which in future, will prove to be of great importance. 
We say that a certain quantity y which participates in a given 
process is limited (in this process), if there exists a positive number C' and 
there is a moment in this process after which we always have || < C. 
This definition somewhat resembles the definition of an infinitesimal 
quantity; however;: there is an essential difference: an infinitesimal 
quantity should in the course of the process become and remain 
(by its absolute value) smaller than an arbitrary positive’ number 
and a limited quantity should be smaller than at least one positive 
number. It therefore, follows that every infinitesimal quantity is also 
a limited small quantity. But the converse statement is not true. Thus 
the distance of the earth (or any other planet) from the sun is, 
evidently, a limited quantity, but it is not an infinitesimal quantity. 
Another example: if the number x increases continuously, then 


*) Here and elsewhere we are using the abbreviated notation of a sum which 
is generally accepted in mathematics : 


n 
amtamtitestan=Vap 
k= m 


where m and n (m <n) are arbitrary integers, a, (m<k <n) are arbitrary 
numbers ; thus for example 


denotes the sum 
l l l l l 1 
ge tqge t+ set ge tart ge: 


The inequality in the text is based on the well-known algebraic rule: the absolute 
value of an algebraic sum does not exceed the sum of the absolute values of the terms. 
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‘sin x is a limited quantity (because we always have|sin x | < 2), but 
it is not .an infinitesimal quantity (because, in any case, we obtain 
the value | sin x | = 1] again and again). Therefore the concept of a 
Jimited quantity is wider (more general) than the concept of an 
infinitesimal quantity. 


Theorem 2. The product of an infinitesimal quantity and a limited 
quantity is an.infinitesimal quantity. 


Proof. Let us assume that ina certain process x is an infinitesi- 
mal quantity and y is a limited quantity and let ¢ be an arbitrary 
positive constant. It follows from the definition of the limited 
‘quantity y that a number C’ exists which is such that from a certain 
moment ‘of our process onwards we always have |_y|<c. On the 
‘other hand, from another moment onwards (owing to the infinitesi- 
malness of x), we ‘have |x| < </c. Hence after the occurrence of 
the latter of the two moments, both inequalities |_y |< ¢ and | x| <e/c 
‘will be satisfied; hence the inequality obtained as a‘ result of the 
term-by-term multiplication 


lel =l+].ly|<— ese 
-will also ‘be satisfied. 


The fact that the number e can be chosen arbitrarily means 
that xy is an infinitesimal quantity, which proves the theorem 2. 


Corollary 1. The product of an infinitesimal quantity and a constant 
as an infinitesimal quantity. 


We saw above that every infinitesimal quantity is also limited; 
we therefore have 


Corollary 2. The product of twoinfinitescmal quantities is an infinitesi- 
mal quantity. 


By means of the method of induction this proposition can be 
extended to include any number of factors. If x1, x2, %3 are infini- 
tesimals, then as a result of the corollary 2, the product x, «2 is also 
infinitesimal; this, as a result of the same corollary 2, shows that 
(x 4%) X3 = X41 X_ X3 must also be an infinitesimal quantity. From 
three ‘factors we can go on to four factors, etc. We therefore have 


Corollary 3. The product of any constant number of infinitesimal 
quantities is an infinitesimal quantity. 


And, in particular, 
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Corollary 4. An arbitrary positive integral power of an infinitesimal’ 
quantity is an infinitesimal quantity. 


We can thus see that the operations of addition, subtraction: 
and raising to an integral positive power performed any number of” 
times and in any order over infinitesimal quantities result in other 
infinitesimal quantities. It is not by chance that these operations 
do not include division. The quotient of two infinitesimal quantities- 
may not be an infinitesimal quantity. In fact, let us assume that 
the quantity x which is involved in a certain process is infinitesimal. 
It follows from corollary 4 that the quantity x? will also be an 
infinitesimal quantity in this process. Let us assume, for the sake- 
of simplicity, that « is never zero; in this event each one of the three 
fractions 
So 


ae, ener 3 


represents the quotient of two infinitesimal quantities. The first 
fraction is equal to x and is therefore infinitesimal; the second’ 
fraction is equal to unity and is therefore limited, but not infinitesi- 
mal; finally the third fraction is equal to 1/x; thus in our process, 
as | x | tends to become infinitesimal, | 1/x | = 1/| x | tends to become- 
as large as we please and therefore 1/x, i.e., our third! fraction, is. 
not only not infinitesimal, but it is not even limited. 


If the quantity « which participates in a process is equal to zero 
throughout this process, then |x| is at every moment of this process- 
smaller than an arbitrary positive number «. It follows from the 
definition of an infinitesimal quantity that x must be infinitesimal: 


A quantity which is equa! to zero through a process is an infinitesimal’ 
quantity in this process. 


$9. Infinitely Large Quantities 


We shall now study another aspect of changes in quantities. 
which is the opposite of infinitesimalness. 


A quantity x is said to be an infinitely large quantity in a given process 
if from a certain moment of this process onwards it becomes greater than a: 
positive number A, which can be as large as we please, so that we have always: 
alee: 


ELEMENTARY THEORY OF LIMITS 27 


Infinite greatness, like infinitesimalness, is thus fully defined’ 
by the behaviour of the absolute value of the given quantity, quite: 
apart from its sign, so that together with x, the quantity | +| must 
also be infinitely large. With regard to an infinitely large quantity 
the same warning must be given as that given in § 7: infinite great- 
ness does not tell us the dimensions of the quantity studied and tells. 
us only of the manner in which it changes; it is therefore incorrect 
to connect the concept of an “‘infinitely large quantity’? with the 
concept of a quantity with very large dimensions. 


Example 1. The distance r from the sun to the comet in the 
example 2, $7, is an infinitely large quantity in the process of” 
movement of the comet. 


Example 2. If the acute angle x approachesa right angle, then 
tan x in this process is an infinitely large quantity. The same thing 
will take place when the obtuse angle . approaches a right angle (in 
this case tan is negative). 


Example 3. If the number w increases indefinitely, then: 
(—1)"2* is an infinitely large quantity (since | ( — 1)”72"| = 2%). 
It can be seen from this example that an infinitely large quantity, 
‘like an infinitesimal quantity, can change its signin the course of the- 
process an infinite number of times. 


Example 4. In the example 3, § 7, we saw that for every cons- 
tant « > 0, the quantity (1 + «)” is an infinitely large quantity- 
when 2 — oo. 


Let us now consider the operation with infinitely large quan- 
tities. The sum of two infinitely large quantities need not necessarily 
be an infinitely large quantity, as can be seen from the following: 
simple example : if x is an infinitely large quantity, then as we saw,,. 
— x will also be an infinitely large quantity ; the sum of these two- 
quantities is always equal to zero, 7.¢. it is an infinitesimal quantity. 


We have, however, the following important theorems : 


Theorem 1. The sum of iwo quantities, one of which is infinitely 
large and the other is a limited quantity, is an infinitely large quantity. 


_ Proof. Let us assume that in the given process x is infinitely large 
and » is a limited quantity. A positive number C exists which is such 
that from a certain moment of our process onwards we always have - 
| y| < C; let A bean arbitrary positive number; owing to the fact 
that x is infinitely large, there will be another moment in our process - 
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after which we always have |x| > 4 + C. Hence by choosing the 
latter of the two moments, we shall always have after that instant: 


|x| >A+C, ly |<, 
hence *) 
lx ty] >ixel)—-jpy|o>A4tC-—-CH= 4. 


Owing to the fact that the number 4 is arbitrarily large, this 
proves that x + 7 is an infinitely large quantity. 


If, as we saw above, the addition of infinitely large quantities 
does not always lead to infinitely large quantities, then on the other 
hand, the multiplication of infinitely large quantities follows the same 
rule as the multiplication of infinitely small quantities. 


Theorem 2. The product of two infinitely large quantities is an 
infinitely large quantity. 


Proof. The reader isby now well-acquainted with the argu- 
ments used for proving theorems of this kind; we can, therefore, treat 
the proof more briefly. If x, and x, are infinitely great in the given 
process and if A is an arbitrary positive number, then from a certain 
moment of the process onwards | *,| > 4/ A, and from another 


moment onwards | x,| > / A | . but from the latter of the two 
moments onwards | x; *2| = |x*,|.|*%2| > 4, which proves the 
theorem. 


From this, in the same way as with infinitesimal quantities, we 
obtain with the aid of induction : 


Corollary. The product of an arbitrary constant number of infinitely 
large quantities is an infinitely large quantity. 


The following proposition connects the concept of an infinitely 
large quantity with the concept of an infinitely small quantity : 


Theorem 3. Jf x is an infinitesimal quantity which is never zero, 
then 1/x is an infinitely large quantity; conversely, if x ts an infinitely large 
quantity which is never zero, then \/x is an infinitesimal quantity. 


To prove this it is sufficient to note that the inequality | x | << 
is equivalent to the inequality 1/| «| > 1/e, and if the number ¢ is as 
small as we please, then the number 1/c is as large as we please. 





*) We are using here a rule which is well-known in elementary algebra : the 
- absolute value of a sum is not tess than the difference of the absotute values of its terms. 
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$10. Quantities which tend to Limits 


In the above sections we have dealt with some of the simple- 
types of changes in quantities, 1.e. we have considered quantities 
which decreased indefinitely and other quantities which increased 
indefinitely and which are known as infinitesimal and _ infinitely 
large quantities respectively. Following our scheme, we shall now 
consider the next large class of a type of change and in doings, so we: 
shall find the concept of infinitesimal quantities very useful. 


In practice and in natural phenomena it happens frequently 
that the variable quantity x tends to come infinitely close to a certain 
constant-a, so that in the course of the process the absolute value of” 
the difference between these quantities becomes infinitesimal; in 
such cases it is said that the quantity x has a limit a in the given 
process or that it tends to a. This is denoted as follows : lim x=a, or 
x + a. the two forms of notation are equivalent. The word lim is 
made up of the first three letters of the latin word limes which means. 
limits or boundary; but the word should be read in English, ze. 
*Jimit’’. 

It is obvious that the quantity x cannot, in this case, have two- 
different limits : in fact, if*—> a, and x — a», then the absolute 
values of the quantities x — a; and x— a, become and remain 
infinitesimal in the given process; hence their difference, 7.e. the 
absolute values of the constant ag — a, must, in the course of the 
process, also become and remain infinitesimal, which is only possible 
when dy, = 4j. 

As we have just said above, the relationship lim x—> a (or x >a), 
where a must be a constant, means that the absolute value of the 
difference x—a becomes and remainsin the course of the given process. 
as small as we please, i.e. it is smaller than an arbitrary constant 
positive number. But, by definition, a quantity which changes in 
this manner is an infinitesimal quantity. We can therefore say that 

The quantity x tends in the given process to a constant quantity a (or, 
which is equivalent, it has as its limit the constant quantity a), provided the 
difference x—a is an infinitesimal quantity in this process. 


Example 1. A heated body (temperature 7',) is immersed in 
water (temperature 7, < 7’',). The body cools down gradually (71. 
falls) and the surrounding water warms up (1’; rises) ; both quantities 
T, and 7, thus tend indefinitely towards an average temperature 
T (1, < T < 7), so that, in the course of the process the differ-. 
ences 7, — 7’ and T', — T become infinitesimal. 
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We thus have 
lim 7’, = 7, limT, = T, 


Example 2. A coin is thrown n times in succession and after 
each throw it is noted whether the head or tail turns upwards. Let 
us assume that after the coin is thrown nv times, the head appears m 
‘times at the top;as 7 increases m, increases aswell. Experience shows 
that when the coin is geometrically regular and physically homo- 
-geneous, then, provided it is thrown a great many times, the head 
will appear at the top half the number of times, 7.e. the relationship 
mjn tends to 1/2; we can take it to be proved empirically that the 
-absolute value of the difference 


m I 


anes 
~when 2 increases indefinitely (by becoming both positive and negative), 
remains in the end as small as we please, i.e. this difference becomes 


.an infinitesimal quantity as the number of times the coin is thrown 
increases indefinitely. Therefore in our process 


I 
x 





. m 
= or —_— 
2 n 


Example 3. If the quantity xin a certain process is infinitesimal, 
then the quantity y = a + bx + cx®, where a, b and ¢ are constants, 
‘tends to the limit a in this process. In fact, y — a = bx +x? and 
if x is infinitesimal, then the theorem in § 8 enables us to say that the 
quantity 6x-+ cx? is also infinitesimal. 


Example 4. If in a certain process the quantity x is infinitesimal, 
ithen cosx tends to unity as its limit. In fact, from a certain moment 
-of the process onwards | x | < 7/2, i.e. the angle x is an acute angle 
-and cos + > 0. It follows from the relationship 1 — cos? x = sin?.x 
that 


sin? x 


eo<l-—- pS Pe 
> ee 1 + cos x 


< sin? x, 


and owing to the fact that apart from x, sin x is also an infiniteismal 
quantity (example 4, § 7), it follows that sin? x (corollary 4 of theorem 
2, § 8) and the quantity 1 — cosx are also infinitesimal and are 
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-confined between zero and the infinitesimal value sin2 x; but in our 
process this means that 


‘ cosx 31, 


Example 5. Let us prove that for every constant a > 0 the 
-quantity "/a tends to unity as its limit, provided » increases 
indefinitely. In fact let it be given arbitrarily thate>0; we know 
(example 3,§7) that as » increases indefinitely, the quantity(1 — ¢)” 
is an infinitesimal quantity and the quantity (1 + ¢)” is an 
infinitely large quantity; therefore provided n is sufficiently large, we 
have 


Pad 


Lar ea = (i aeeiae 
shence J—e<cVacl+e, 
-Or We Eee 
‘which proves our proposition. 


The above examples show us that the way in which a variable 
‘quantity tends to its limit can be very diverse in character. Thus in 
example 1 the temperature 7’, tends to its limit 7’ by decreasing 
continuously; On the other hand, the temperature 7’, (in the same 
example) tends to this same limit 7' by increasing continuously. In 
-example 2 (the experiment with throwing a coin) theory and practice 
show us that by increasing the number of times the coin is thrown, the 
“fraction of heads’? m/n becomes greater and smaller, (and sometimes 
-equal to) 1/2; we are dealing here with a quantity which increases 
‘.and decreases in the process under consideration while it tends 
towards its limit. 


t ole . . 
In spite of the fact that quantities show great differences in 
behaviour when tending towards their limit, they also share many 
“properties in common; this makes it possible to include them in the 
-same class. We shall now study some of their properties. 


Theorem 1. A quanti*y which tends to a limit in a given process is a 
limited quantity in this process. 


Proof. Let us assume that in a certain process x > a. In this 
ase the difference x —a is infinitesimal and, therefore, from a 
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certain moment of the process onwards | « — a| <1; hence owing to. 
the fact that x = a + (x — a), we have 


[| <la|+|*—a|<lal+! 
This inequality, on the right-hand side of which stands a 
certain constant positive number, is satisfied from a certain moment 


of the process onwards; but this means that the quantity x is. 
limited in this process. 


Theorem 2. If in a certain process x > aand a> o, then froma 
certain moment of the process onwards we shall always have x > o. 


In other words, if a given quantity has a positive limit, then 
from a certain moment of the process onwards the quantity itself” 
will be positive. 


Proof. Let 6 be an arbitrary positive number smaller than: 
a(0 <5< a). Owing to the fact that the difference + — a is 
infinitesimal, we shall have from a certain moment of the process. 
onwards 

|x—a|<; 
since « = a + (x — a), we have from that moment onwards 
xD>a-—|x—al>a—b>0, 

which had to be proved. 


Corollary 1. Jf in a certain process x —- aand a < 0, then from a 
certain moment of the process onwards we shall always have x < 0. 


Corollary 2. Jf x — a, and from a certain moment of the process 
onwards x > 0, thena > 0. If from a certain moment of the process onwards 
x <0, thena ¢ 0. 


The proof of both these corollaries isso obvious that we shalt 
not give it here. 


Jet us now assume thatin a certain process x—> 0. This, as we 
know, is equivalent to the fact that x — 0= x is an infinitesimal 
quantity ; we thus arrive at the following proposition : 


Theorem 3. Every infinitesimal quantity has zero as its limit and, 
conversely, every quantity which tends to zero is infinitesimal. 


This theorem is very important. It shows that infinitesimal 
quantities which we considered earlier are a particular case of 
quantities which tend to a limit. On the other hand, infinitely 
large quantities cannot tend to a limit; this follows from theorem 1, 
for, evidently, an infinitely large quantity cannot be limited. 
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We have finally : 


Theorem 4. very constant a is its own limit. 


In order to prove this it is sufficient to say that the relationship 
a —> ais equivalent to the fact that a — a must be an infinitesimal 
quantity; buta — a =O and the constant zero is, as we know, always 
an infinitesimal quantity (cf end of § 8). 


Other properties of quantities which tend to limits are con- 
nected with operations with these quantities; we shall deal with 
these in the following paragraph. 


§ 11. Operations with quantities which tend to limits 


Theorem 1. /f in a certain process X,—> dj, %_—> dg, +, 

Xn —> Qn, then 
Hb emt... Aw ma tagt... + ay. 

This theorem is frequently formulated as follows: the limit of 
an algebraic sum (with a constant number of terms) is equal to the 
algebraic sum of limits; this formulation is even more obvious if 
the theorem is written down in its equivalent form: . 

lim (4, + x. -—E «.  x,) =lim x, thm x, +... blimey. 

It is only necessary to remember that it is assumed that each term 
has a limit; this is the necessary requirement of this theorem; on 
the other hand the existence of a limit of the algebraic sum as a 
whole is then no longer assumed but maintained (and, of course, 
proved). The full (but rather lengthy) formulation of theorem 1 
should read as follows: if in a certain process every quantity xi (1 <i <n) 
has a limit, then the algebraic sum of these quantities also has a limit and 
this limit of the algebraic sum is equal to the algebraic sum of the limits of 
terms This note also refers to all subsequent theorems of this kind. 

Proof. It follows from the assumptions made with regard to 

this theorem that in the given process all the differences 


1 — Ay = Oy, Xy — dg = Aq, ey Xn — An = Sp 
are infinitesimal quantities. It follows from theorem 1, § 8 that their 
algebraic sum a, + % +... £ G, is also an infinitesimal quantity 
but this algebraic sum is, evidently, equal to 

(y AS gig fen ags + x_) — (a + ay ck we E an); 
from which it follows directly that 
skwmg bk. bmeakadt.. + an, 


and the present theorem is thus proved. 
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Theorem 2. If in a certain process 1 —> Gy, Xz —> Qgy +++ Xn —> Any 


then 
Ny Xq vee Xn > Ay Ag ose One 


Procf. To begin with, let us prove this theorem for two factors 
(n == 2). Let us assume that x; — a, = %, X2 — a2 = % and that 
a, and a, are infinitesimal quantities. Hence 


Ky = Ay yy, My = ay Tb Me, 

XyXq = QyAg + Ay, -b Gy%y -b % Me, 

HyXq — Gydg = Ay%q Ay, PF Hy %p. 
On the right-hand side of the last equation all the three terms are 
infinitesimal (the first two as a result of corollary 1, and the last as 
a result of corollary 2 of theorem 2, § 8); it follows from theorem 
1, § 8 that the right-hand sides and therefore also the left-hand sides 
are infinitesimals. But the infinitesimalness of the difference 
Xy %_ — a, a, Means that x, x2 —> a, a,; hence we prove the theorem 
in the case when n = 2. It is not difficult to prove the theorem 
for n = 3, and later for n = 4, etc.; thus for example if x; > a3 
and the theorem is already proved for n = 2. Hence 

lim (x) 2 %3) = lim [(x, x2) x3] = lim (x, x2) lim x3 = 


= lim x, lim x, lim x5, 


which proves the theorem 2 for n = 3. 


. Theorem 3. [fin a certain process x a andk is a constant, then 
kx —> ka. 


Owing to the fact that k - k asa result of the theorem 4, § 10, 
it follows that theorem 3 is an immediate corollary of theorem 2. 
Theorem 3 can also be formulated as follows: 


lim (kx) = & lim x, 


as a result of which this theorem can also be formulated as follows: 
a constant factor can be taken outside the limit sign. 


Theorem 4, [fin a certain process x—> a and nis an arbitrary constant 
natural number, then x™ —> a”. 


This theorem is obviously a particular case of theorem 2. 


Theorem 5 follows from the theorems 4, 3 and 1. 
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Theorem 5. Jf P(x) =agx" tayx "1+... tani x tan 
ts an arbitrary polynomial of x and if in a certain process x — a, then in this 
process P(x) —> P(a). 


Example. Let P(x) = 2x3 — 4x2 4+ 5x— 12. If in a cer- 
tain process x ~—> 2, then 


P (x) > P(2) = — 2. 


So far we have only studied the operations of addition, subtrac- 
tion, multiplication and raising to a power with a constant natural 
index as applied to quantities which tend to limits. We shall now 
go on with theorems connected with division. 


Theorem 6. Jf in a certain process x-»a and a0, _ then 
1/x — 1/a in thts process. 


Proof. To begin with, it followsfrom theorem 2, § 10 {or from its 
first corollary) that because a ~ 0, we have from a certain moment 
onwards x + 0, so that 1/x is not devoid of meaning. Furthermore, 
owing to the fact that x — a@ is an infinitesimal quantity, we shall 
have from a certain moment onwards | x — a| < 4|a| and therefore 


lx}=la+(*—a)|>]al|—[lk-—aj>l[al—tla|=4]al, 
hence : 
1 2 
— <-, 
|x| ~ al 
1 2 


which means that ao =. 
| ax| a 


This inequality shows that 1 / ax is a bounded quantity in our process 
‘Therefore the quantity 


1 1 1 

Bog So ae 
as a result of theorem 2, § 8 is an infinitesimal quantity, which means 
that ]1/x-> 1/a. Theorem 6 is thus proved. 


Theorem 7. Jf in a cerlain process %1—> 4y,%_-> Gq and if 
ay ~& O, then x,/x_ > a;/ a2. 


The proof of this theorem follows directly from the theorems 6 
and 2(n = 2). 
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' Corollary. If P(x) and Q(x) are two arbitrary pep noma! of x and 
in a certain process x > a and Q (a) 4 0, then wks 


P(x), Pla a 
me Fae oh ae - Q(x) Q (a) i 


It follows from the fact that x > a and from theorem 5 that 
P(x) > P(a), Q (x) > Q (a); therefore the relation to be proved is a 
particular case of theorem 7. 


Theorem 7 enables us to express the limit of a fraction, in, terms 
of the limits of the numerator and the denominator of this.fraction 
in all cases when these limits exist and when the limit of the, denomi- 
nator is other than 0. Ifa, = 0, then this theorem cannot be used 
for the study of the fraction x,/«». It can be readily seen that when 
a, = 0, the fraction x,/*, can only have a limit provided'a, = 0; 
since *4 = (x1 /%) ¥2, then provided lim x, = 0 and there is’ a 
lim x,/*_ = b, we have from theorem 2 (n = 2): 7 


a, = lim x, = lim> lim x2 = 6.0 = 0. 


Hence we atrive at the following conclusion. 


Theorem 8. If the denominator of a fraction is infinitesimal, ee the 
fraction can only have a limit provided its numerator 1s also infinitesimal: 


In this case the given fraction represents a quotient of two 
infinitesimal quantities. Such a quotient, as we saw in § 8, can 
change in very diverse ways; therefore every case must be studied on 
its own merit. We must, however, emphasize that the analysis of 
the mode of change which is characteristic of one or other ratio of 
two infinitesimal quantities is, as we shall see later, one ofthe ‘most 
important problems in mathematical analysis. At the erid‘of this 
section we shall consider a definite case of a problem of this kind. 


Before doing this, however, we shall establish two more proposi- 
tions which are very important in the assessment and the, practical 
evaluation of limits of variable quantities. ig 

‘Theorem 9. If x-> a, y —> 6 and beginning from a certain moment 
of the process x > pimphes a > b. oa 

For proving this theorem, it is only necessary to apply; eat) 
2 of theorem 2, § 10 to the difference x — ). 


ef 


. 
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‘Theorem 10. Jf starting from some moment of the process we always 
have ii; ) 
| =a), Kye ye, NS (1) 


Er da! + 
TH ad hae 


and if the quantities x 1 and x» tend in this process to the same limita, then, a is 
the limit of x. 


Proof. It follows from (1) that 


OS x —x,y Sx. —- *, 


hence 
|x — x3! <|[x_2— x4]; (2) 


but lim (x, — #3) = lim x, — lim x, = a— a = 0,50 that x, — x 
is infinitesimal ; it follows from (2) that x — x, is also infinitésimal, 
so that x — x,—> 0; but 


w= ay t+ &— ¥4); 
since. 4, —> aand x — x,» 0, therefore «> a + Os a, which was 
to be: ‘proved. oO 


y er 

‘The importance of theorem 10 is due to the fact that in definite 
cases the quantity x, the limit of which we are trying to-find,- has 
sometimes a complicated form difficult to analyse, which makes our 
problem very difficult ; it is then possible to say that x always lies 
between two other quantities x; and 
x» which have a considerably simpler 
form : if we also succeed in showing 
that the quantities x, and x, tend to 
the same limit a, then it follows from 
theorem 10 that x — a; we are thus 
able to find the limit of x without 
having to analyse directly its complica- 
ted expression. Let us now consider 
a definite example of this kind which we shall be. able to use. as one 
of the most important examples in calculating the limit of the ratio 


of two. infinitesimal quantities. " 


Pee 53 


Problem. Let x be an infinitesimal quantity in a certain process ; 3 ut 
is required to prove that sin x { x has a limit and to find this limit*®. , 





* We are assuming for the sake cof simplicity that « does not vanish in this 
process. 
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’ Solution. Fig. 8 represents part of the usual trigonometrical 
circle of unit radius. The area of the triangle OAC is evidently 
equal to #sinx cosx and is smaller than the area of the ‘ciccular 
sector OAB which is equal to 4 +; the latter is smaller than the area 
of the triangle ODB which is equal to 








sin x 
dtanx = 4 ; 
cos x 
Hence 
: sin x 
4 sin x cosx <<}¢x <4 2 
cosx 
and therefore 
1 





cosx% << ae < a 
sin x cos x 
But when x — 0, we have (example 4, § 10) cos x — 1, which means 
that according to theorem 6, I/cos x > 1. Both the right and left- 
hand sides of the above inequalities tend to unity when x —> 0. 
Therefore, according to theorem 10, we can conclude that 


x 


sin x ? 


and therefore (by applying theorem 6 again) 


sin x = 


lim’-—— <1, 
x 


when x + 0. For the sake of simplicity we are assuming that x >0; 
but owing to the fact that the value of sin x/x remains unaltered 
when x is replaced by — x, the result remains valid for every 
approximation of x to zero. 


The above result is of the utmost importance in finding limits 
of quantities, the expressions of which include trigonometrical func- 
tions. Thus if x is an infinitesimal quantity, then the numerator and 
the denominator of the fraction 
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are also infinitesimal; owing to the fact that 





1 cos xX = sin? x : 
1+ cos« ’ 
we have 
sin? x 1 1 (nz) 
l+cosx <x? 1 + cos x x ; 


but, when « > 0, we have : 
cosx—>1l, ——— +], 


which means that 


§ 12. Infinitesimal and infinitely large quantities of 
different orders 


We shall return fora short time to infinitesimal and infinitely 
large quantities in order to somewhat supplement their theories. 


Let us assume that in a certain process two infinitesimal 
quantities x and y are involved and that we wish to compare them 
with respect to the rate at which they diminish. To do this let us 
consider the ratio y/x (we shall assume for the sake of simplicity that 
at least, from a certain moment of our process onwards, x does not 
vanish so that the quantity y/ x is at no time devoid of meaning). It 
may happen — and we saw examples of this kind in § 8 — that the 
ratio y/«x is itself infinitesimal; this evidently means that in our 
process y is an infinitesimal quantity and that it is not only small in 
itself but it is also small in comparison with the infinitesimal x, so that 
provided the process is sufficiently advanced, | y | will only comprise a 
negligible part of { «|; this will beso, for example, when y = x*. 
In this case we say that y is an infinitesimal quantity of a higher order as 
compared to x. Conversely, x, in comparison with y, has a lower 


degree of smallness. 


Let us now assume that the ratio y/x is an infinitely large 
quantity in the given process; it follows from theorem 3, § 9 that the 


40 A COURSE OF MATHEMATICAL ANALYSIS 


reciprocal ratio x/ y will, in this case, be infinitesimal and therefore « 
has a higher degree of smallness as compared to J (and y has a lower 
degree of smallness as compared to x). 


Let us finally consider the case when in a given process the ratio 
y/x of two infinitesimal] quantities can neither decrease indefinitely 
nor increase indefinitely, but its absolute value remains confined 
between two positive boundaries; this means that two positive 
constant numbers a and 6 exist so that from a certain moment of 
our process onwards we have : 


It is obvious that this means that in the given process neither 
of the quantities | x | and | y| can, by decreasing, considerably outdo 
one another. In this case it is said that the quantities x and y have the 
same order of smallness, or they are infinitesimal quantities of the same order. 
In particular this occurs when in the given process the ratio y/ x tends 
to a limit a other than zero; in fact, if this is so, then no matter how 
small ¢ > 0, we shall have from a certain moment onwards 


aj e< 2) < la +s, 


where, provided « is sufficiently small, the number | a|— <and 
|a| + © are positive constants. 


It is evident that in the course of their variation the infinitesi- 
mal quantities x and y are particularly close to one another when 


=lim(2) =1; 


and in this case x and _y are said to be equivalent infinitesimal quan- 
tities. The equivalence of infinitesimal quantities x and y is denoted 
as x ~ y. We have shown at the end of the previous paragraph 
that the infinitesimal quantities x and sin x are mutually equiva- 
lent. ‘The concept of equivalence of infinitesimal quantities is very 
important in the evaluation of limits; its importance is based on the 
following proposition : 


Theorem 4. Jf x and y. are equivalent infinitesimal quantities and 
zis a third quantity which is involved in this process, then tt follows from 
xz —> a that yz -> a. 
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In other words, when a quantity tends towards a limit and if 
one infinitesimal factor is replaced by another equivalent infinitesi- 
mal quantity, then the quantity which has been changed in this way 
will tend to the same limit. 


To prove theorem | it is sufficient to say that it follows from 


a 


yz 
- x 


a NZ 
that 
lim (92) = lim (2) lim (xz) = 1. a =a. 


With the aid of theorem 1 it is frequently possible to replace 
individual infinitesimal factors of an expression by other equivalent 
but simpler, infinitesimal quantities; this is very useful in evaluating 
limits ; it is thus possible to simplify the solution of a given problem. 
Thus in the solution of the last problem in the previous paragraph 
we could have replaced in the expression 


sin? x 1 
1+ cosx) x? 


sin? x by x®, since sin x ~ x, i.e. we could have written simply 


1 


ee a. ee 
1 + cosx 


lim y = lm 
The same equivalence of sin x ~~ x makes it possible, for 
example, to find from infinitesimal quantity x, 


i Se ao oe 

8 +-.3x x(x? + 3) xt 3 $ 
In the above we considered cases of two infinitesimal quantities x 
and y which take partina given process such that: (1) one has a higher 
degree of smallness as compared with the other and (2) both quantities 
have the same degree of smallness (i.e. they are equivalent to one 
another). These two cases do not, however, cover all the possible 
interrelationships between the order of decrease of two infinitesimal 
quantities which take part in the same process; on the contrary, the 
cases which we considered above are only the simpler instances and 
can be studied very easily. Generally speaking, the ratio y/x of two infini- 
tesimal quantities can be much more complicated; for. example, the 
quantity | y/x | can, in the course of the process, become infinitesimal 
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and later infinitely large, and both phenomena can take place 
again and again no matter how far advanced the process. In this 
case we cannot ascribe to y» {as compared to x) either a higher or a 
lower or even the same degree of smallness and we must admit that 
the quantities y and x cannot be compared with one another with respect to 
the rates of their decrease. From a logical point of view we should 
consider this case, where comparison is impossible, as the general 
case; however, in practice we meet more often one of the special 
cases which we have considered above. 


All that has been said so far in this section about infinitesimal 
quantities can also refer, with appropriate corrections, to infinitely 
large quantities. Let us assume that the quantities x and y are 
infinitely large in a certain process. If the ratio x/ y isinfinitely large, 
then x is an infinitely large quantity of a higher order as compared to 
y and y is an infinitely large quantity of a lower order as compared 
to x. If|x/y| from a certain moment onwards remains confined 
between two constant positive numbers, then x and y are infinitely 
large quantities of the same order; this will always be the case when 
there is a lim (x / y) in a given process which is other than zero ; in 
particular, if x/y — 1, the infinitely large quantities x and y are said 
to be equivalent and this is denoted by x ~ y. When evaluating 
limits we can replace infinitely large factors by arbitrary equivalent 
quantities in the same way as this was done with infinitesimal quan- 
tities. 

As with infinitesimal quantities, it can be very useful to assess 
the order of infinitely large quantities not only qualitatively (higher, 
lower, equal) but also quantitatively. This can be done as follows. 
An arbitrary infinitesimal quantity, for ‘example x, is chosen as the 
basis; all other infinitesimal quantities which are of the same order 
as x are said to be infinitesimal quantities of the first order*; in parti- 
cular, any infinitesimal quantity which is equivalent to x will be an 
infinitesimal quantity of the first order. To continue: the quantity 
x and all quantities of an equal order are known as quantities of 
the second order. Generally speaking, any quantity of an order equal 
to that of x*, where « is an arbitrary positive constant, is known as 
an infinitesimal quantity of order «. The rate of growth of infinitely 
large quantities is determined in a similar manner. 





* Let us remember : y is of the same order as x if froma certain moment of 
the given process onwards wealways have a <\|y/x |< 6, where a and & are 
positive constants, 
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Example 1. The problem solved at the end of the previous. 
paragraph shows that if x is taken as the basis, than 1 —cos x will be: 
an infinitesimal quantity of the second order. 


Example 2. Let 
Y= a + ag xg + ota x", 


where the consiants aj, da», ...,@, are other than zero and the positive 
numbers 1, mg, ..., mM are such that n, <m<... < m. Thus 
(1) if» is the basic infinitesimal quantity, then » is an infinitesimal 
quantity of order m,; (2) if x is an infinitely large quantity, thenyis an 
infinitely large quantity of order n,. 


In conclusion of this paragraph we shall introduce another very 
convenient system of notation which is used more widely in contem- 
porary mathematics and which we shall find very useful in future. 
Let y and x be two quantities which are involved in a certain process 
and let x always be positive,{or at least from a certain moment of the 
given process onwards). We then have: (1) if the ratio y/x is a 
bounded quantity in this process, then this is written downas follows: 


y= 0 (x); 


(2) if the ratio y/x is an infinitesimal quantity in the given process. 
(i.e., its limit is zero), then this is written as follows : 


y =o (x). 


It evidently follows from y = 0 (x) that y = O (x), but the 
converse is not true. It is self-evident that we assume in both these 
relations a definite process in which both quantities x and _y participate 
and that, generally speaking, in any other process this will no longer 


be so. 


Example 3. If x is an infinitesimal quantity, then 
x® = 0 (x), 
5x -+ 3x? = O (x), 
2sinx = O (x), 


1—cosx =o (x). 
Example 4. If x is an infinitely large quantity, then 


x = 0 (x*), 


5x2 + 3x? =O (x”). 
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Example 5. For any arbitrary change in x it follows: from 
y =o(x) that x +.» ~ *; conversely, it follows from x > 0 and 
x+y ~«x that y =o (x). 


Example 6, The fact that the quantity « is infinitesimal in the 
‘given process can be denoted as follows: 


x = o(1); 
and similarly, the relation 
1 =o (x) 


is equivalent to the statement that x is a positive infinitely large 
quantity in the given process and the relation 


x= 0 (1) 


is equivalent to the statement that the quantity x is bounded in the 
‘given process ; we can thus see that the symbols O and o enable us, 
in certain cases to express very briefly the character of change of 
different quantities. 


CHAPTER III 


DEVELOPMENT OF THE ACCURATE THEORY OF 
LIMIT TRANSITION 


§ 13. The mathematical definition of a process 


Until now we assumed that all the quantities which we have 
considered above participated in a certain process (phenomenon) and 
tried to elucidate the character of their change in the course of this 
process. We were talking about differcnt moments of the given pro- 
cess and differentiate between its earlier and later moments.’ This. 
method of expression is picturesque, sirnple and convenient ; it helps 
the student to understand the origin of the main concepts of 
mathematical analysis (variable quantities, functions, limits) from his 
observations and studies of the outside world. However, from the 
point of view of mathematical theory, it is necessary to introduce greater: 
accuracy into this form of expression; the concept of a process and its: 
various moments, which we have used so far, was not defined mathe- 
matically and, when using this concept, we had in view no definite 
mathematical objectives apart from the convenience of the pictures- 
que representation linked with our everyday experience. In order 
to become a fully valid science which can be subjected to mathe- 
matical investigation each process must be fully defined mathemati- 
cally and be freed of ideas which are not defined in this way; this 
form of description can serve as an abstract formal characteristic 
without which no mathematical theory can function. 


When considering the real or abstract mathematical processes 
dealt with in earlier paragraphs, it can be readily seen that this 
mathematical characteristic, this formal structure of the process can 
be very different in different processes. However, there is one 
characteristic which all processes share in common and it is this cha- 
racteristic which we must try to elucidate. ‘This common character- 
istic is due to the fact that the different moments of any process are 


45 


46 A COURSE OF MATHEMATICAL ANALYSIS 


always represented by a sequence of successive values of a certain 
variable which changes in which the given process is essentially con- 
cerned; it is therefore natural to call this quantity the basic variable 
of this process. Let us explain this by examples. 


Example I. In the course of the process described in example 
3, §7 (a geometrical progression, the n-th term of which is 1/2”) the 
n terms of the progression run successively through a series of natural 
numbers (n = 1, 2,...). By different ‘‘moments’”’ of the process we 
mean different values of the number 7, where the lower values of 7 
correspond to the “earlier”? moments and the higher values to the 
‘later’? moments of the given process. By the quantity which 
“‘participates”’ in this process we mean any function of 7; in particular 
one such function is the function 1/2” which we have considered in 
this example. The “basic’’ variable of this process is the number n. 


Example 2. In the example 1, § 7 (expansion of a gas at cons- 
tant temperature) the volume z of the given mass of gas is the basic 
variable; in this process the value of v grows indefinitely. By differ- 
ent moments of the process we mean different values of v. As 
in the above example, the lower values of w refer to ‘‘earlier’’ 
moments and the higher values of v to “later”? moments. In 
contrast to the above example where 7 acquires only integral values, 
the value of v increases continuously and in passing from one 
value to the next it runs through all intermediate values. Here 
again we take it that the quantity which “‘participates” in the given 
process can be any function of v; in particular, one such function is 
p = c/v which we have considered in example 1, § 7. 

i} 


Example 3. Let us now consider a-process which involves a 
continuous decrease in the positive number x; we take it that this 
number is the basic variable‘of the given process. The ‘‘earlier’’ 
moments will be the greater and the “‘later’’ the smaller values of x. 
The quantity which participates in this process can be any function of 
x, for example, 1 + x + x*, cos x, etc. In thiscase the basic variable 
behaves differently from that in either of the two processes considered 
above; it does not increase but decreases and tendstowards zero. In 
example 4, § 10 we have analysed the behaviour of cos x which partici- 
pates in a process of this kind. 


Let us now draw some conclusions. We can see that from a 
mathematical point of view every process should be regarded asa 
series of successive values ofa certain variable quantity, ‘“‘basic’”’ for 
the given process. The individual values of this variable represent 
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the moments of the given process, where a lower value corresponds to 
an earlier moment and a higher value to a later moment, or vice 
versa, (in ot her words, the basic variable either increases continuously 
in the given process or decreases continuously). The quantity which 
participates in the given process can be an arbitrary function of the 
basic variable. 


Bence these are the common characteristics of the processes 
which we have studied so far. What, then, can be the differences bet- 
ween these processes from a mathematical point of view? If we were 
to disregard the real contents of these processes and were only tocon- 
sider their mathematical structure, then, as we can see, the only 
difference lies in the behaviour of the basic variable. It is the 
character of the behaviour of this variable which influences the 
mathematical nature of the process and this, as we have seen above, 
can vary greatly. Apart from the three types of processes which we 
have considered above, many other cases are possible which have an 
even more complicated structure; thus, for example, we can imagine 
a process of “‘mixed”’ structure in which the basic variable changes 
either by jumps (as in the first example) or continuously (as in the 
other two examples); however, for the purpose of mathematical 
analysis, the structures which we‘have considered above are basically 
important, and therefore, we shall study them alone. Wecan, thus, 
regard every process as a series of successive values of a certain 
“basic” variable; the value of this variable can be expressed in 
terms of natural numbers (i.e., it may change by jumps or increase 
continuously) or it changes continuously by running through inter- 
mediate values; in the latter case it can either increase continuously 
or it can decrease continuously; if, for example, it increases conti- 
nuously, then it can either increase indefinitely or it can remain 
bounded; a continuously decreasing quantity can also behave in an 
analogous manner. In every case the character of change in the 
basic variable fully defines the mathematical type of process. As we 
know, these types can be very diverse; however, for the purpose of 
mathematical analysis, it is quite adequate to consider only a few 
simple types of processes mentioned above. 


§ 14. The accurate concept of limits 


In chapter 2 we agreed that a quantity y which participates in 
a given process tends towards the constant limit 6 if the difference 
y—6 is an infinitesimal quantity in this process; thus the concept 
of a limit is always given in terms of an infinitesimal quantity. 
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But what exactly do we mean by infinitesimal quantities? We have 
said that the difference y—d is infinitesimal if no matter how small the 
positive number e be, the inequality | y-6 | < ¢ will always be satisfied from 
a certain moment onwards. As we have already said in the. previous 
paragraph, we can no longer be satisfied with this formulation which 
involves the concept of a process and its moments; for they are not 
defined accurately. However, we now know the accurate definiticn 
of a mathematical process; hence by replacing the indefinite terms. 
of “process”? and its “moments” used for picturesque description by 
the corresponding strictly accurate mathematical concept, we aré 
fully capable of defining the concept of an infinitesimal quantity (and 
therefore also the concept of a limit) with absolute accuracy. The 
accurate definition of a limit, which we are trying to give in this 
paragraph, can be expressed in different ways for different types of 
processes; we shall therefore have to formulate it separately for every 
type of processes listed in the previous paragraph, This is in contrast 
to our earlier, mot quite accurate definition of a process which could 
be formulated in the same way forevery type of process; thus, by using 
this definition, we were able to define in chapter 2 the theory of 
limits for processess of all mathematical structures. 


1. The limit of a sequence. Let us consider a process in which 
the basic variable n runs successively through a series of natural 
numbers (n= 1, 2, ...). Any function of m can participate in the 
process, for example 1/2", 2!, the perimeter p, of a regular n-sided 
polygon inscribed in a circle of unit radius, etc. Let a, be one such 
function. In this process a, runs successively through the sequence 
of values 


Dy, Bay very Any (1): 


Let us now try to explain accurately the statement that “the quantity 
a, tends to a limit « in the given process’. 


We know that the fundamental idea of this statement is as. 
follows: no matter how small ¢ > 0 be, the inequality | a,—« | <e 
will be satisfied from a certain moment of the process onwards. But 
what is meant by “from a certain moment of the process onwards ?’” 
By the moments of our process we mean different values of the basic 
variable n —greater 2 corresponds to the later moment. Therefore 
the words “froma certain momentof the process onwards” mean more 
accurately “beginning with a certain value ny of the number n and 
for all its greater values”. The statement which we are trying to. 
define accurately can therefore be formulated as follows: the quantity 
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a, tends towards the limit «, if no matter how small the positive number e, a natural 
number no exists which is such that we have|\a, — «| < © for anyn > ng. 
It is evident that this formulation is much more complicated than 
the one used previously, but it is quite free of concepts which are not 
fully defined (“process” and its “moments’’). ‘Therefore, this defini- 
tion of a limit can now be used in the construction of a strict 
mathematical theory. 


In processes of the type we are considering, it is more usual to 
speak not of a “function a,”’ but of a ‘sequence of numbers” (1). In 
the event when_an—p, the sequence (1) is said to be convergent and the 
number & is known as its limit. Ifa, has no limit, then it is said that 
the sequence (1) is divergent. 


The fact that the basic variable n increases indefinitely in the 
course of the process, is frequently denoted symbolically as follows: 
n— oO, or more accurately, 2 —> + ©; it must be remembered that in 
this symbolic notation the arrow does not indicate a tendency towards 
a limit, as is usually the case, for an pechniey increasing quantity 
can have no limit. The sentence ‘‘the sequence_(I) tends to the. 


limit «’? (the exact meaning of which we now fully understand) can 
therefore, be expressed symbolically as ‘follows : 


lima,=2, 


no 


an > & (n> oc); 


and both forms fully express the fact in which we are interested 
(lim a, = &% or a, >) apart from indicating the nature of the 


process in which they take part (7~> 00 ). 


Example. Let us denote the sum of the first 2 terms of a geo- 
metrical progression 


fe. le : 
Be a Pe TER a ee 


by a, 3; we thus have 
1 1 1 
ee gee rege ge 


and the sequence (1) becomes 


| 1 1 1 
lI->, l~ 7» ya? re 
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We evidently have a,—>1(n— oc). Thus owing to the fact that 
1 
[an — 1| = aq (t= 1,2,.--); 


and no matter how small « > 0, we can choose mg so great that 
n 
1 /2°° <¢,so that for every n > no: 
lan —1|<e. 


2. The one-sided limit of a function. We shall now consider 
the second basic type of process, 7. e. a process in which the basic 
variable x varies continuously, 7.¢. it runs through all intermediate 
values; in doing so it can either increase indefinitely or decrease inde- 
finitely and thus remain limited, or it can become an indefinitely 
large quantity, 7.e. its absolute value can grow indefinitely. Each 
case must be considered on its own merits; however, all cases have 
many common characteristics which enable us to treat them more 
briefly. In every case the quantity y which participates in a process 
is assumed to be an arbitrary function y = f (x) of the basic variable 
x and we are here trying to explain clearly the exact meaning of the 
statement “‘in the given process the quantity y tends to the limit d”’. 


Let us first consider the case when the basic variable x grows 
indefinitely and is a positive number (x — + 00)*. 


This case is very close to the previous case and the only 
difference is due to the fact that here x runs through all intermedi- 
ate values in the process of its growth, whereas in the cther example 
ncould assume only integral values. As before the words ‘“‘from 
a certain moment onwards”? mean “‘beginning with a certain value 
Aof x and for all its greater values’. ‘The exact meaning of the 
statement 

lim y = 6 or yob(x>oo) 


x—~ 
‘ 


here is as follows : no matier how small the positive number e is, there exists 
a positive number A such that|_y — b| < ¢ for any x > A. 


In cases where the basic variable x is a negative infinitely ‘large 
quantity (x -» — oo.), ze, although it is a negative quantity its 


* The notation x > © or x > + © is used to denote the indefinite growth of 
x, both when this growth takes place by jumps and when it is continuous; for this 
reason the actual type of variation should in each case be indicated in the text. 
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-absolute value grows indefinitely, the relationship » — b is obviously 
-defined in the same way: the relationship 

lim y= 0b or y-+b(x->— -@) 

. x7>— 2 

means that no matter how small <« > O may be, there exists a positive number 
A such that|y —b|<¢ foranyx < — A. 


Let us now consider the case when the basic variable changes 
-continuously (i.e. increases or decreases continuously) and remains, at 
the same time, a limited quantity. We shall learn in chapter IV that 
dn this event x tends to a certain limit a. If x grows indefinitely, 
then it approaches a from the side of the lower values (‘from the 
left?) and this is usually denoted by: x» a—0O. If x decreases 
‘continuously then it always remains greater than the number a and 
approaches it from the side of the greater values (“from the right’’) ; 
this is denoted as: x a+ 0. To begin with let us consider 
tthe first case (x < a, x» a—0). The words “from acertain moment 
of the process onwards”? evidently mean here ‘‘beginning with a 
certain value a — 5<a of x, and for all values closer to a (and, of 
-course, smaller than a); more briefly we can say: ‘‘for all values of 
x which satisfy the inequalities a — 8 < x <a’’. The exact mean- 
ing of the statement 


lim y = 5 or y>b (x >a — 0) 

x—>a—0 
is as follows: no matter how small the number <> 0, there exists a positive 
number & such that |y — b| <e for any value of x which satisfies the 
inequalities a—§ Kt<a. 


The exact meaning of the statement given below is determined 
in a similar way 


lim y= or y>b(x->a+t 0) 


.and is formulated in exactly the same way except that the inequality 
a—&<«x <a must be replaced by a <x <a+6. 


We have thus established the exact meaning of the concept of 
limit for all processes of the basic types which are used in mathe- 
matical analysis. Let us emphasize once again the fact that all 
arguments and results obtained in chapter II which were the same 
for all types of processes, are, of course, also valid for our new and 
more exact definition of limit transitions; the new definition does not 
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contradict in any way our old definition with which it is compatible— 
it only provides more exact specifications for cases of different kinds. 


Let us now make one more remark. Let us assume that the- 
quantity .y which participates in a certain process, does not tend 
towards a limit, but continues to grow indefinitely. Let us assume- 
that we are dealing with a process of the type x — a — 0; we can,. 
therefore, write 


> +r (x>a—0). 


What is the exact meaning of this statement? From all that was. 
said above, we are able to answer this question without difficulty : no- 
matier how small A > 0, there can be found a § > O so that we have y > A! 
for all values of x which satisfies the inequahitiesa ~8 Qu<a. 


By using this as an example, the reader will be able to find for’ 
himself the exact meaning of the relationships y-> + co and _y — — oo 
in any process of the type considered above. He will find this to be- 
an excellent exercise.* 


§ 15. The Development of the Concept of Limit Transitions 


The two types of limit transitions (the limit of a sequence and’ 
the one-sided limit ofa function), :shich we considered in great detail: 
in the previous paragraph, are of basic importance in mathematical’ 
analysis, for, all other more complicated types of processes which we- 
shall encounter in future can be broken down to those cases. How- 
ever, to make this reduction possible in every case, we must now 
develop somewhat the concept of a quantity which tends towards. 
a limit in a given process. 


Let us begin by considering a simple example which will show 
us the necessity and the course of this development. Let us assume: 
that the process in which we arc interested involves  infinite- 
decrease of the perimeter # (‘basic” variable) of a certain rectangle 
where the form of this rectangle can change in the course of the: 
process in any way we please. Owing to the fact that in a rectangle- 
of perimeter p, eachside is smaller than  / 2, the area s ot the rectangle: 
of perimeter p will always be smaller than p?/4. When p > 0, we: 


* Cf. problems 349-352, section 1 of the ‘problem book’ by B. P. Demidovieh: 
mentioned in the preface. The numbers of the problems as they appear in the- 
second edition, can be found on p. 622. 
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-evidently have p*/4— 0; therefore, the area s in our process (i.e. 
~when p — +0), is an infinitely small quantity, and we can write 


5 —>0(p-> +0). 


The exact meaning of this statement is determined in the usual way: 
.no maiter how small ¢ > O, there exists a & > 0. such that the area of any 
-rectangle, the perimeter of which is smaller than 6, will be smaller than «. 


This example differs basically from all the examples which we 
-considered so far. This difference is due to the fact that for a given 
perimeter #, the area s of a rectangle can have an infinite number of 
-different values, so that s ts not a function of p. Owingto the fact that 
we have taken p as the basic variable in our process, and also because 
so far we assumed that the quantity participating in a given process 
‘is a function of the basic variable, we cannot, strictly speaking, con- 
sider 5 to be a quantity which participates in our process; it is even 
less possible to speak of its tendency towards a limit. Here we are 
-dealing with a quantity whose value at every moment of the process 
(t.e., for every value of f) remains indefinite. At the same time it is 
still true to say that provided the perimeter p of the rectangle is 
‘chosen sufficiently small, the area s of this rectangle, no matter what 
infinite number of possible values it may assume, will be as small as we 
please. More exactly: no matter how small ¢ > 0, there is aB > 0, 
such that for any rectangle with perimeter p < 8, we shall have s < ¢, where 
xis any possible value of the area of a rectangle with a perimeter p. 


Hence the accurate meaning of the relation 
s5+0 (p> +0) 


which is generally accepted, remains valid for our example, in spite of 
the fact that-s is not a function of ~. It is, therefore, possible to apply 
to examples of this kind all propositions of general theory which were 
stated in chapter II. It is now only necessary to develop our mathe- 
matical interpretation of the phrase ‘‘a quantity participating in a 
_given process” and to determine the concept of the tendency towards 
-a limit as applied to this extendedclass of quantities. The above 
-example shows quite clearly that this must now be done. To begin 
with, from now on we shall understand by a quantity which partici- 
pates in a process, any quantity y with regard to whtch tt is known what 
values it can assume for any given value of the basic variable x (t.e., at any 
-given moment of the process); it is thus evident that our former 
agreement that y must.always be a function of x is a particular case 
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in the wider definition which we now accept; we arrive at this parti-- 
cular case by assuming that the set of values which y can take for the- 
given value of x, is always a single number. Let us assume that our’ 
process is described by the relationship x ~ a + 0. In this case the 
exact meaning of the statement that in the given process lim y = & 
(where y is a quantity participating in this process as given by our’ 
wider definition) involves the following: no niatter how small « > 0,. 
there is a 8 > O, such that for any value of x confined between a and a + 6. 
and for any » possible for the given value of x, we have : 


ly - b| <e. 
If this requirement is satisfied, we can write : 
york («>a+t+O0). 


Two-sided limit of a function. Let us now consider an impor- 
tant example of the application of the wider definition of the concept 
of limit transition as given above. This example will show that our 
wider definition is already useful during our first attempt in mathe- 
matical analysis. 


Let us assume that y = f (x) is a function of x and let the value- 
of y get as close as we please to a number 4 when the value of « is. 
sufficiently close to the number a (and is, at the same time, other 
than a). By now we are well-acquainted with the exact meaning 
of statements of this kind: no matter how small e > 9, there is a8 > 0, 
such that for every0 <|{x —a| <8, we have|y —6|<e. Symboli-. 
cally this can be written as follows 


yorb (|x—-al>+ 0). (1) 


According to our system of notation this symbol means that the 
quantity | x -- a| is the basic variable in the process under considera- 
tion and that y tends to the limit 4 in this process. But every given 
value | x — a| = @ of the basic variable | x — a‘ corresponds to two- 
different values of x: x =a-+ a,x = a— a, and therefore, there 
are, generally speaking, two different values of y: y =f (a + a): 
and y = f(a — «). Hence for any value « of the basic variable, the: 
quantity y can assume two different values and therefore, it is not a: 
function of a single basic variable. Nevertheless, our wider definition 
of limit transition enables us to write the relationship (1) and to. 
maintain that_y tends towards 6 as its limit, when | x — a| > + 0.° 


ACCURATE THEORY OF LIMIT TRANSITION 2D 


By the way, the process | x — a|—» + 0 is usually written in 
the form x — a, so that instead of the relationship (1) we can write 


yp b (xa). (2) 


The notation x — a, in contrast to the former notations x —> a— 0 
and x + a-+ 0, shows that in this case, x approaches the number 
a, but that it must not necessarily increase or decrease: it can 
change the direction of its transition and, in particular, become greater 
or smaller than a. Therefore, the limit of y when x -> a, which we 
just described, is known as the two-sided limit of a function. 


Let us remember once again that the exact meaning of the 
limit transition (2) involves the following : no matter how smalle > 0, 
there is a8 > O, such that for any value of x for whichO<|x—ai< 8, 
we have|y — b| <e. 


Let us now make one more important remark : in order that the 
number b should be the two-sided limit of y when x — a, it is necessary and 


sufficient that the one-sided limits of y, viz. lim y and lim y, should exist 
x —->at0 x—> a—0 
and be equal to b. In fact letus assume that ¢ > 0 is given arbitrarily. 


If 

lim y = 5, 

x—>a 
then provided we have a sufficiently small 5 > 0, it follows from 
O<|x*—a|<Sthat|y—ob|<c«. But ifa<*<a+6, then 
even more so, | x — a| < 8, and therefore, we also have| y — b| <. 
Thus when » > ) (x > a+0), it can be shown similarly that this is 
also true when y > 6 (x > a — 0). Let us now assume, conversely, 
that we are given y — 6, when x > a + 0, andwhen «>a — 0, In 
that case, no matier how small « > O we can find a 8, which is such that 
|y —b| <e, whena<x <a +8), and such a 8, that |y —b|<e 
when a — 85 <x <a; if we denote by 5 the smaller of the numbers 
8, and 5,, then a—8 <x Sa+8(x 4a), and we have 
|» —6| <<; this shows that y— b (¥ — a), which had to be 
proved. 


We can thus see that the process of two-sided approach of the 
variable x to the limit a simply involves the process of the one-sided 
approaches « > a +0 andx—a—0. This is the first example 
illustrating what was said in the note in § 14, i.e. that different types 
of analyses can be reduced to the study of the two basic types of 
processes. 


CHAPTER IV 
REAL NUMBERS 


§ 16. Necessity of Producing a General Theory of 
Real Numbers 


One characteristic of a variable quantity arises from the fact 
that in the course of a process it assumes different values. Each of 
these values is expressed in terms of some number. If, for example, 
temperature of air rises from 5 to 10°C, we naturally assume that in the 
course of this process it runs gradually through all the numbers from 
5 to 10. But what exactly do we mean by “all the numbers” ?  Itis 
evident that these numbers are not restricted to integers alone, for 
obviously there are moments when the temperature is equal to 6°5°C. 
Do we, perhaps, mean “all integers and all fractions” ? 


The set of all integral and fractional numbers (positive, negative 
and zero) forms the so-called set of rational numbers ; these numbers and 
the operations which can be performed with them are studied in 
detail, in arithmetic and algebra. The question whether these 
numbers are sufficient for measuring all the quantities which we are 
likely to meet in the study of the world around us is of great impor- 
tance, both in mathematics as well as in the accurate study of nature. 
In ancient Greece (probably in the Pythagoras school) a remarkable 
discovery was made, vzz. that certain simple geometrical constructions 
lead easily and irrevocably to quantities which cannot be measured 
with the help of rational numbers. A simple case of this type is very 
well-known: if each side adjacent to the right angle in a right-angled 
triangle is of unit length, then according to the theorem of Pythagoras, 
the hypotenuse of this triangle should be such that its square is equal to 2. 
But it is easy to show that there is no rational number whose square 
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is equal to2*. Therefore, if we want to restrict ourselves to rational 
numbers, we must admit that the hypotenuse of the triangle in ques- 
tion has no length; obviously we cannot arrive at this conclusion, for 
geometry cannot be based on this absurdity. Circumstances in the 
- outside world thus make it impossible for us to restrict ourselves to 
the set of rational numbers alone; it is therefore necessary to add a 
new type of numbers which we shall call irrational. One such number 
is 1/2, the square of which, by definition, is equal to 2. However, 
it must be remembered that the introduction of a new number 
is an easy matter which does not by itself have any significance; 
if we wish to make this newly-introduced number a fully valid 
number of the family of numbers, we must, to begin with, define 
its position in this family, 7.e. we must determine which rational 
numbers are smaller and which, greater than 4/2. In the second 
place, we must define all operations to which this new number can 
be subjected, (for we do not know, for example, what is meant by 
V2 4+ 1, 3/2, 1/+/2), and we must prove that these operations are 
subject to the same laws which govern operations with rational 
numbers (for example, we must show that 1/2 + 1 = 1 4+ 4/2). 
All this can be done, though it would necessitate considerable effort ; 
however, the object we have in mind fully justifies this procedure. 
But let us assume that we already did all this. Sooner or later we 
shall meet another physical or geometrical problem which will make 
necessary to introduce another new number, the square of which 
is equal to 3 or 5, etc. It would thus no longer be possible to repeat 
in each case the same chain of arguments which we used for making 
/2 a fully valid number. Let us now assume that we have found 
a way which would enable us to use a single method for introducing 
square roots of all natural numbers into the family of numbers (this 
is, no doubt, possible). The possibilities of applications are hereby 
not exhausted. If we are'trying to find the length of the side of a 
cube, whose volume is equal to 2 m3, we must introduce the number 
4/2. And even if we do introduce roots of any degree of any 
rational number into the fainily of numbers, this will not be 
sufficient. On one hand, the required number is frequently defined 
as a root of a given equation; on the other hand, we know practically 
* If we have (p/g)2 = 2. then we find that p? = 2q¢?;letp = 27p’, 
.g = 2%’, where p’ and gq’ are no longer even numbers. Then we have 
pr=QWWwZpr®, t= WestW 9/2, 
and the equality p2 = 2 2 leads to a contradiction, for its left side contams 2 with 
. an even index and the right side contains 2 with an odd index. 
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that there must be one such root, whereas theory shows that there 
is no such root among all possible rational and irrational numbers; 
and again we find it necessary to introduce a new number which we 
simply define as the root of our equation. Here again we must 
repeat the same argument which we used above in connection with 
the number 4/2. In practice, even the simplest geometrical problems 
may lead to difficulties of this kind. This is particularly shown by 
the following example in which we try to find the area of a circle of 
unit radius. We know that the area of a circle is defined as the 
limit of the areas of all inscribed (or circumscribed) regular polygons 
when the number of sides of these polygons increases indefinitely. 
We know from this visual representation and practice that a circle 
has an area; in reality, can we reconcile ourselves to the fact that 
such a simple figure as a circle has no area at all? At the same 
time mathematics tells us that there is no such limit among all 
the numbers so far handled, including the roots of all algebraic 
equations. Hence we have no alternative but to introducea completely 
new number for measuring the area of our circle and repeat once 
again the chain of arguments mentioned above, in order to make this 
new number a fully valid member of our extended family of numbers. 
This new number is no other than the well-known number 7. 


The above examples clearly show that the procedure is un- 
scientific and unpracticable, if, in order to solve a problem, for whose 
solution the existing numbers are insufficient, we find it necessary to 
introduce new numbers, define their position among the existing 
numbers, find and investigate the operations which can be performed 
with them, etc.,—in other words—to do all that is necessary to make 
them fully valid members of the family of numbers. It is thus quite 
clear that a general theory of irrational numbers must be produced ; we 
must find one general principle of origin of irrational numbers (the 
numbers studied so far are particular cases) which would include all 
the historically known examples of this kind, and thus guarantee that 
it will no longer be necessary to introduce further new irrational 
numbers. For numbers originated by this general principle, it will 
be necessary to repeat all arguments in general form, but this will in 
future enable us to operate with them in the same way as we do with 
rational numbers in elementary arithmetic and algebra. This is the 
only scientific approach to the problem in question. 


All this work is not a part of mathematical analysis—a science 
which deals with changes in quantities—but is part of the theory of 
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numbers; however, until this problem is solved, mathematical ana- 
lysis can have no stable basis ; in fact, as we have already said at the 
beginning of this paragraph, the values of all variable quantities are 
expressed in terms of numbers; therefore, we cannot even begin the- 
study of variable quantities without knowing the numbers which 
modern mathematics has at its disposal and the properties of this 
set of numbers. A short outline of the modern theory of this set of 
numbers is given in the next few paragraphs of this chapter. 


§ 17. Construction of a Continuum 


1. When we evaluate +«/2 with the help of conventional 
methods we obtain the following sequence of approximations for this - 
number : 


@y= 1; ay= r4s a,—] 14ls ag = 1°414;..... 


Each one of these values is a rational number (a finite decimal fraction} 
and each number is greater than the preceding number (or, at least, . 
is equal to it). The squares of these numbers tend to 2. * 


a*, > 2(n-—> 0 ). 


However, the numbers a, cannot tend to a rational limit: if such a 

limit r exists, then a, -> r would imply a,? — r?, andsince a,* > 2, 

we would have r? = 2; but this would mean that a rational number 

r exists such that its square is equal to 2, which, as we know, is. 
incorrect. 


We thus have the sequence 
Bo, 41, 42,-+ +53 Anroes (1) 


of well-known numbers; this is an increasing sequence, 2.¢. we always. 
have dn 41 > 43 at the same time this sequence has no rational 
limit. Wherever we are introducing the new (irrational) number 





* In fact, each one of the numbers a » is such that if we take its last decimal: 
place by one unit greater, we obtain a number whose square is > 2 ; hence 


1 \2 
ay <2<(an+ iq)» 
and therefore, 


2 2 2 1 \2 
0<2— an <(on+ Za) — & = ict + (ia) ~ 0 (n—> 00). 
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1/2 whose square is by definition equal to 2, we are filling in, as it 
“were, a gap existing between rational numbers: our number must fill 
‘this gap in the set of rational numbers and be defined as limit of the 
‘increasing sequence (1). 


The situation created by the introduction of the irrational 
‘number a is very similar to the one which we have just described. 
Let us assume that the area of a regular n-gon inscribed in a circle 
-of unit radius is equal to s,,; in this case the numbers 


Sie Gigs Ses Ap be Gage ais (2) 


‘form an increasing sequence and the number =z is defined geometri- 
-cally as limit of this sequence. Here the position is somewhat compli- 
cated by the fact that the area s,, is, generally speaking, expressed in 
terms of irrational numbers; however, these numbers are among the 
.simple irrational numbers and can easily be expressed in terms of 
roots of natural numbers; we can, therefore, assume that the area sy, 
is expressed by a well-known number. It now appears that the 
“sequence (2) has no limit either among rational numbers or even 
-among the numbers of the wider class in terms of which the area 5» 
is expressed. Thus by re-introducing our new number 7 we are filling, 
-as it were, a gap existing in the set of all the numbers we have met 
‘so far, and this number is the limit of the increasing sequence (2), 
i.é. it is a limit which did mot exist among the numbers we have 
Iknown so far. 


Let us assume now that we are given an arbitrary increasing 
sequence 


Pith oe od Tig ew ge ee Tw) (3) 


of rational numbers. ‘To begin with, we must distinguish two cases: 
the number 7, can grow indefinitely as n increases; or a positive 
number C can exist such thatr, < C for any n. In the first case ry 
is an infinitely large quantity when n -> 00, and therefore, it cannot 
‘tend to a limit. We shall, therefore, concentrate on the second case, 
remembering, that for the moment we only have rational numbers 
-at our disposal. In the case under consideration the sequence (3) is 


-bounded ; it may happen, however, that it has a rational limit r; thus 
‘the sequence 


Pe ees Tog = eee ee, eae 


0 ie aaa n eee 
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is an increasing bounded sequence which tends to unity as its limit : 


1 
a ere (1 —» 00 ). 

It may also happen that the bounded increasing sequence has. 
no rational limit; thus, for example, the sequence (1) of approxima- 
ted values of 4/2 is evidently an increasing bounded sequence (all 
a, <2), but at the same time we have seen that it has no limit. 


Let us now agree (in the same way as we did when introducing 
the irrational number 4/2) that every time when we deal with a bounded’ 
sequence (3) of rational numbers, for which there is no rational limit, we shall’ 
take a new irrational number as tis limit.* We have ‘thus established a 
general principle of origin of irrational numbers. Having made this. 
agreement, we have also defined the whole set of irrational numbers. 
We shall see later that the set satisfying this definition has, in fact, 
taken some final form; in future we shall not introduce other new 
numbers apart from those defined by our agreement. 


2. Example. Let us assume that a, = (1 + 1/n)", (n= 1, 2,...), 
so that all the numbers a, are rational (4;=2, a, = 9/4, a3 = 64/27, 
etc.). We will show that the sequence of numbers a, is an increasing 
bounded sequence and that has an upper limit. According to the- 
binomial formula we have : 





He a) a 


* We shall show at the end of this paragraph that this number does, in fact, - 
satisfy the definition of a limit. 
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‘Similarly, 


ant = 1+ ot ie 
n+1 


=1+ aC -sC-saq) 


k=1 
siesta 


A comparison of the right-hand sides of the formulae (4) and (5) 
-shows that in the sum (5) each term is greater than its corresponding 
term in the sum in formula (4), since the replacement of n by n + 1 
-causes an increase in each small bracket in formula (4) ; moreover, 
there is an additional term in formula (5) corresponding to k=n+ 1 
‘which is absent in formula (4). Therefore 








Oye Ste (i= Alyce sy 


.t.e. the sequence of numbers a, is increasing. It also follows from 
formula (4) that for any n 


n 
1 
m<it+ypro, 
k=1 


-and owing to the fact that k! > 2%-1 fork > 1, we have 


-and this shows that the sequence of numbers a, has an upper limit. 


In accordance with the accepted principle of origin we should 


therefore, assume that this sequence has a limit lim a, = ¢ (rational 
n—~w © 
-or irrational). Further analysis, which we are unable to give here, 


shows that the number ¢ is an irrational number.* We shall later 
see that this number ¢, like 7, is one of the most important numbers 
in mathematical analysis; we shall meet it again in many chapters of 
‘our coursee The first few decimal places of this number are as 
follows : ¢ = 2.71828... 





* This means that the sequence of numbers a2 y has no rational limit. 
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It is obvious that the above argument is only the first step to 
produce a general theory of irrational numbers. All rational 
numbers and all irrational numbers which we introduced on the 
basis of the principle of origin are real numbers. The set of all 
numbers is called continuum. ‘Yhe continuum represents the set of 
‘‘values’’ which can be assumed by a ‘‘continuously” varying quantity. 
The basic aims of the theory of continuum are as follows : (1) to intro- 
duce ‘‘order” among the set of real numbers, z.e. to determine under 
what conditions one real number is greater than, equal to, or smaller 
than the other; (2) to determine ‘all algebraic operations which 
-can be performed with all real numbers and (3) to establish the laws 
which govern these operations. All these problems are satisfactorily 
‘solved by modern mathematical theory—all operations within our 
wider region of numbers are subjected to exactly the same laws as 
-operations with rational numbers. Moreover, the number of 
“operations which can be parformed becomes wider : thus when 
-dealing with real numbers, we can, for example, extract roots of any 
natural degree of any number (except for roots of an even degree of 
negative numbers, for they are no longer real, but imaginary 
numbers, and we are omitting them here). Within the scope of this 
course of mathematical analysis, we are unable to give sufficient 
attention to the development of this theory and we must, therefore, 
-accept its conclusions as a ready basis for our further investigations. 
We shall thus restrict ourselves toa few brief remarks on this problem. 
The reader who is notinterested in the theory of continuum can omit 
the points 3, 4 and 5 of this paragraph and pass on directly to point 6. 


3. Let us assume that the increasing sequence 7,, fro, 


- 8 @ gy 


‘Ymy--. defines a real number x. If all the numbers 7, from a certain 
number & onwards, are equal to one another, 7.¢e. rk = 741 = 7k+2 
= ,..=7, then evidently « = 7, and ~ is a rational number. This 


‘sequence 7» is called stationary sequence ; it is obvious that if « is an 
irrational number, the sequence determining this number is never 
‘stationary ; however, if « is rational, the sequence ry, can be station- 
ary [rr =a, n= 1, 2,...], or non-stationary [7, =« — 1/n, 
n= 1,2,...]. This shows that in the construction of continuum, 
“we could restrict ourselves to the consideration of non-stationary, 
increasing sequences of rational numbers. 

. Let us assume that we are given two non-stationary increasing 
bounded sequences of rational numbers 


TrysTa seer Tn or eres (r) 


Sz_s Sq yee ey Snyees (s) 
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As we know, each sequence originates a real number which can _ be- 
rational or irrational. Let us assume that « is this number [for the 
sequence (r)] and 8 [for the sequence (s)]. We must now solve the 
problem, which of the three possible relations « << 8,*>B,«=8 
applies in this case. 


Let us agree to say that the sequence (s) is a major (exceeding) 
sequence as compared to the sequence (7), if for every number r,, of” 
the sequence (r), a number s,,, of the sequence (s) can be found such 
that 5, > 7, (meaning of this inequality is clear, since the numbers 
ry, and s,, are rational). We can have four different cases : 


(1) (s) is major as compared to (r) and (r) is major as com-- 
pared to (s); 


(2) (s) is major as compared to (r) but (r) is not major as. 


compared to (s); 


(3) (r) is major as compared to (s) but (s) is not major as. 
compared to (r); 


(4) (s) is not major as compared to (r) and (r) is not major as 


compared to (s). 


It can readily be seen that the fourth case is impossible. In 
fact, if (s) is not major as compared to (r), then a number, can be: 
found such that s,, <7, for any m; but it is obvious that in this case: 
(r) is major as compared to (s). We, therefore, only have to consider : 
the first three cases. In case (1) we are assuming that « = 8, in case- 
(2) that « << B and in case (3) that « > 6. These assumptions uni- 
quely define which of the three relations applies to any pair of real. 
numbers. It can readily be shown that in tlie event when both 
numbers « and 8 are rational and (r) and (s) are strictly increasing - 
sequences, the above concepts of equality and inequality would, as- 
expected, coincide with the conventional concepts. 


We must now find out whether the definitions of equality and! 
inequality of real numbers, as given abOve, possess the same proper-- 
ties as those for rational numbers. Let us consider, for example, the 
transitive property, which is due to the fact that« <p andp cy 
implies « <¥. This is a well-known property of rational numbers ;. 
but for real numbers it must be proved on the basis of our definition. 
of equality and inequality. ‘This can be done quite easily: to begin 
with, we must establish the transitive property of majority, i.e. if 
(s) is major as compared to (r) and (¢) is major as compared to (s} 
then (é) is major as compared to (r). 
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4. After establishing all necessary propertics of equality and 
inequality, the theory of continuum tries to establish the operations to be 
performed with real numbers, e.g. how to determine the sum « + B 
of two real numbers. Let us assume that « is defined by the sequence 
(r) and 8 hy the sequence (s) ; then 


Po SE Sig he ap Gees ne gle Pay takes (t) 


is evidently an increasing bounded sequence of rational numbers; the 
real number Y thus defined is naturally the sum « + 6 ofthe numbers 
wand 8. It can readily be shown that when « and § are rational, 
this definition of a sum coincides with the conventional definition. It 
‘can also be shown that this definition of addition conserves all rules 
of operations as they apply to rational numbers; thus, for example, 
the interchange of terms in addition (2.e. the rule « +86 =6+ a) 
follows directly from the definition, because an interchange of posi- 
tions of the sequences (r) and (s) does not alter the sequence (¢). 


Other operations with real numbers are determined in a similar 
manner, and the properties of these operations can be shown to be 
the same as those of the corresponding operations with rational 
numbers. ‘We shall not consider subtraction, multiplication and 
division of real numbers, raising these numbers to integral positive 
powers or extraction of roots of integral positive powers. We 
shall only consider the definition of the expression a*, where 
a> 0 and vis any real number (the definition. of an exponential 
function). Let us assume that a> 1; then the rational a® is 
also defined for any x, and is a rational function of x; in fact, if 
x = p/qand r’= p'/q are rational numbers and ifr <r’ (p < p’), 


1 


1 1 
men ‘a Maree: pr 
then «@* > 1 and therefore a™ = (2 4 y < (« a ) sgt, 


Let us now assume that the real number « is defined by the 
increasing bounded sequence (r) of rational numbers. In this case 
the sequence 


is evidently bounded, and it follows from the above proof that it is 
also an increasing sequence. Hence it defines some real number 
which is evidently the number a*. In this way the exponential 
function a* is defined for any real x; at the same time we also estab- 
lish the fact that this is an increasing function (ifa > 1), and a de- 
creasing function (if@ < 1). <A logarithmic function is defined in a 
similar way. 
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It follows from these definitions that the known properties of 
the rational values of arguments of these functions also apply to alk 
real values; thus we have in all cases a7+¥ = a*a®, log, (xy) 
= log, x + loga J, etc. 

We are unable to pay greater attention to these problems. 
within the scope of this course. 


5. There is, however, one more point which must be clarified. 
In the above wording of the principle of origin of real numbers, we- 
said that the number « has originated from the increasing bounded. 
sequence of rational numbers 


Ty Va 52+ ey My ees (t) 
and is assumed to be limit of this sequence. To convert this state-. 
ment into a real tool of investigation, we must prove it; having learnt 
the arithmetic of real numbers, we are now, in principle, able’ to do- 


it. It is evidently necessary to prove that no matter how small « > 0, 
we shall have for all sufficiently large n: 


aA— fy, <<. 


To begin with, let us prove the following auxiliary result on: 
sequences of rational numbers. 


Lemma. Let (r) be an increasing bounded sequence of rational 


numbers. In that case, no matter how small < > OQ, there is an index ng , 
such that n > no for m > ng, and we always have ry — Tm <&. 


Proof. Let us assume that the statement expressed by the 
temma is incorrect, 7. e. that there is an ¢ > O such that the in- 
equality 

Tn — Tm 2 e 
is satisfied for all values of n and m which can be as large as we 
please. In this case, no matter how large the natural number k, 
there are k pairs of indices (mj; , nz) (1 <¢ < &) such that 


My OnNy Omg ng SK... Sm <n, 


and 
Tn — Tm, Ze (l<igh); 


but in this case 
ae 2 ae —fT ma —T 7 —?T 
"2 uy "k me) ™ at ee a) 


+1 ) Pie ) a eee aS he 


n 
&-1 k-2 


yews 
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for the first, third, fifth, etc. brackets are not smaller than ¢ and the 
second, fourth, etc. brackets are positive. Hence 


ae oe hke+ Ty 
Owing to the fact that k can be as large as we please, the sequence 
(r) will contain terms which are as large as we please, and this con- 
tradicts the fact that it is a bounded sequence. This proves our 
theorem. 


Let us now assume that ¢ is an arbitrary rational number; it 
follows from the above lemma that r, — rz; <¢ fora sufficiently 
large & and for any 7; therefore, the sequence 


eS ra eo are 
is a major sequence as compared with 
Ty — ley To — hye ees In a hye ee gg 


which evidently gives the real number « — r;; owing to the fact 
that the sequence (e) gives the number ¢, we have by virtue of the 
definition of inequality of real numbers 


a—mHEoe, 
for sufficiently large k. 


This proves the proposition for a ratonale ; but owing to the 
fact that for any real e > 0, we can find ¢’ > 0, smaller than <, we 
would prove the proposition for any real <e > 0. 


We must also draw attention to the fact that the principle of 
origin of irrational numbers accepted by us is by no means the only 
possible method ; in the second half of the last century, when the 
necessity of producing a general theory of real numbers became 
apparent, several such theories were advanced almost simultaneously 
and each theory had its own principle of origin; it later became 
obvious that all these theories are basically equivalent so that the 
choice of theory should be governed not so much by principle as by 
the convenience of the method of treatment and its applications. 


6. The wider set of numbers which we are now studying, is, 
as we know, by no means the first in the historical development of 
numbers. To begin with, we learn about the natural numbers in 
arithmetic, to which subsequently zero, negative and fractional 
numbers were added. Thus as a result of successive additions, the 
set of rational numbers is obtained. Our principle of origin adds to 
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them all irrational numbers and thus develops it into the set of real 
numbers, i.e. into the continuum. We know thatall previous additions 
to the set of numbers were prompted, to greater or lesser degree, by 
our wish-to be able to perform some operations under all possible 
conditions, which could otherwise not always be achieved with the 
help of the older system of numbers. Thus the introduction of zero 
and negative numbers enabled us to deal with all cases of subtraction ; 
the introduction of fractions produced the same result with regard to 
division (with the exception of division by zero which, by the way, 
still remains impossible even within our new system of real numbers) ; 
the introduction of irrational numbers was prompted by our desire to 
be able to extract roots. This tendency to deal with operations, 
which could not always be performed otherwise within the existing 
set of numbers, was prompted in mathematics not so much by an 
abstract argument leading to a formal goal (as it issometimes believ- 
ed), but by practical necessity ; this is best seen by examples like 
those introduced at the beginning of this chapter ; thus we were 
unablc to obtain results in cases where the length of the diagonal of 
a square of unit side, was required, or, when we were trying to find 
the area of a circle of unit radius, because the set of numbers at our 
disposal was insufficient for this purpose. 


A strict scrutiny of our principle of origin thus shows that the 
introduction of the wider set of numbers was prompted by ovr wish 
to be able to perform certain operations under all circumstances 
whereas this could not always be achieved with the help of rational 
numbers alone. This involves the creation of a limit of a bounded increas- 
ing sequence of numbers. This is no longer an, arithmetical operation. 
One of the characteristics of an arithmetical operation is that all 
arithmetical operations are always performed with a finite group of 
numbers ; on the other hand, our operation requires the existence of 
an infinite sequence of numbers, and with the help of all these numbers 
a new number is originated, which is the limit of this sequence. This 
is an analytical operation, i.e. one of the first and simplest operations 
of mathematical analysis. 


The widening of the existing set of numbers which was 
undertaken in order to guarantee performance of any operation with 
numbers achieves its goal only if the operation is possible within the 
wider range of numbers. We must therefore convince ourselves that 
every bounded increasing sequence has a limit within the range of real numbers. 
However, this can readily be proved. In fact let 


eh Cig it ee se bts (6) 
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be one such sequence, i. ¢. &44, 22% for any 2, and there is a 
number C which is such that «, < C for any n; here all «, are 
arbitrary real numbers. 


If from a certain place onwards, all the numbers in the sequence 
(6) are equal to one another, then the common value of these 
numbers will evidently be the limit of the sequence (6) ; therefore, we 
can right from the beginning reject this case and assume that the 
sequence (6) contains an infinite number of different unequal numbers. 
Let us assume that these different unequal numbers in the sequence 
(6) increase in the following order 


Bi; Be.---,Bns---(Bnt+i > Ba). 


Denoting by 7,, any rational number between 8, and 6,4, *, 
we have 


By <7) <Pe She See Be Te = Baan Se 


# 

The sequence of the rational number 7, is evidently an increasing 
bounded sequence with an upper limit, and therefore, according to 
our principle of origin, it tends to the limit « (which can be rational 
or irrational) ; owing to the fact that r,z,-; <B»< rn, we have, 
according to theorem 10, § 11,8, —>4«(n-—» o). But the sequence 
(6) consists of the same numbers (,,, each of which is, generally 
speaking, repeated several times; thcrefore, «, —> « (n> ©). 


We can thus say that our aim to find a region of real numbers 
(continuum) by extending the region of rational numbers has been 
achieved ; the new operation is one of the basic operations of mathe- 
matical analysis which involves transition from an increasing 
bounded sequence to its limit, and can readily be performed within 
our extended region of numbers. 


This property of continuum is of fundamental importance in 
the purely logical construction of mathematical analysis as we shall 
see in later sections. 


§ 18. Fundamental Lemmas 


The fundamental property of continuum which we have just 
established above enables us to draw far-reaching conclusions which 
tend to define more fully and in greater detail the set of real 

* The arithmetical theory of real numbers shows that infinitely many rational 
numbers can be taken between any two real numbers. 
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numbers, its structure and the laws governing them. We are only 
interested here in conclusions which can be applied most generally 
to the structure of mathematical analysis. We shall establish several 
such theorems in this section; we call them ‘fundamental lemmas”, 
because each of them essentially contains one of the most frequently 
encountered methods of application of continuum to the structure of 
analysis. ‘Thorough comprehension of these auxiliary propositions 
which will frequently be referred in future enables us to simplify and 
abbreviate subsequent treatment of the subject. 


Let us understand by a linear section a set of all real numbers x 
which Satisfy the inequalitiesa < x < 6, where a and b(a < 6) aretwo 
arbitrary real numbers ; we shall assume that this linear section con- 
tains both its ‘‘ends’” a and 5; under such circumstances it is some- 
times said to be a ‘‘closed”’ section, in contrast to an “open” section 
which is defined by the inequality a < x < } (not containing its ends). 
Let us call the sequence of sections 


Bes, Ads co55 Resend (1) 


(contracting if 1) all points of the section A, +, belong to the section 
An for any n (symbolically Anui = An), and (2) A, > 0 
(n — 00 ), where A, denotes the length of the same section. 


Lemma 1 (on contraction of a sequence of sections). Jf (1) ts 
a contracting sequence of sections, then a single number « exists which belongs 
to all sections A». 


Proof Let us denote by a, and b, the left and right ends of 
the section A, respectively ; then itis evident thata, <a, <... 


Kan S..., anda, < 6b, for any n; hence the sequence ofnumbers 
ad, iS an increasing sequence bounded from above, 7.e. lima, = &. 
n—->oo 


Let us now assume that £ is an arbitrary natural number; ifn > &, 
then the section A, belongs completely to the section Ax, so that 
ak San < by 5let usnowassume that n > ocoand kremains constant; 
owing to the fact that at the same time a, > 00, we have from the 
last inequalities of theorm 9, § 11 


ak R*< by, 


t.e. the number « belongs to the section Ax; also in view of the fact 
that & is arbitrary, it follows that « belongs to all sections of the given 
sequence. In order to prove uniqueness of this number let us assume 
that there is yet another number 8 > « which also belongs to all 
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sections Az; in that case the length of each of these sections should 
not be less than 8B — «, which contradicts the condition that 
Az > 0 (k- «). Hence lemma 1 is proved. 


Let us now assume that we are given a system of sections (S) 
(finite or infinite). Let us agree to say that the system (S) covers a 
certain section A if each one of the numbers belonging to A lies 
within at least one of the sections of the system (S).* 


Lemma 2 (on finite coverage). If the system (S) covers the section 
A, then a finite system of section can be chosen from it which would also 
cover the section &. 


Proof. For the sake of brevity we can say that an arbitrary 
section § permits finite coverage if it can be covered by a finite group 
of sections chosen from the system (S). We shall prove converse of 
lemma 2, 7.e. we assume that the section A does not permit finite 
coverage and thus try to show a contradiction. Let us divide the 
section A into halves; if both halves permit finite coverage, then the 
whole section A_ will evidently also 
permit finite coverage; but since it = nel 
does not permit finite coverage, it eae es 
follows that at least one half of it é 
does not permit finite coverage; let us FES 
denote this half by A, (ifmeither half permits finite coverage A, would 
denote either half). ‘The section A, which does not permit finite 
coverage is again divided into halves, and we denote by Ag the 
half which does not permit finite coverage. We can continue 
this process ad infinitum and obtain a _ sequence of sections 
A, Ai, As,.--, An, none of which permits finite coverage; these 
sections evidently form a contracting sequence; therefore it follows 
from lemma | that a number «@ exists which belongs to all those sec- 
tions. Since « belongs to the section A which is covered by thesystem 
(S), it follows that « lies within at least one section A* of the system 
(S). But each of the sections A, contains the number «; also the 
length of the section A,, tends to zero as n increases, and therefore 
the section A» will lie completely within the section A* for a suffi- 
ciently large n (Fig. 9). This gives us the necessary contradiction: 
on one hand the section A, does not, by its definition, permit finite 


* We must emphasize the importance of the condition that each number of 
the section A must lie within one of the sections of the system (S$) and should not 
simply belong to it ; if it were the case, then lemma 2 would not be true. 
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coverage while on the other it is covered by one of the sections A * 
of the system (S). Lemma 2 is thus proved. 


We shall now introduce a very important concept of bounds of 
the given set of numbers. The set Jf of real numbers is said to have 
an upper bound if a number C exists such that all numbers of the set 
M are smaller than C; thus the set of all negative numbers has an 
upper bound (where C can be zero or any positive number); on the 
other hand the set of all positive numbers has no upper bound. 
Similarly the set M is said to have a lower bound if there is a number 
C such that all numbers of the set M are greater than C. A set 
which has an upper and a lower bound is simply said to be bounded. 


We now say that the number @ is the wpper bound of the set 
if this set does not contain numbers which are greater than 6, there: 
exists a member of the set which is greater than @ — « for an 
arbitrarily smalle >-0. Similarly we say that the number « is the- 
lower bound of the set M if this set contains no numbers smaller than 
%, but there exists a member of the set which is smaller than « + -« 
for smalle > 0. It is thus obvious ‘that the upper bound is the 
smallest number which do not exceed any number of the set 4/; a 
similar case applies to the lower bound. 


Example. The set of positive rational numbers whose squares 
are smaller than 2 has 0 as its lower bound and 1/2 as its upper 
bound. 


In general, both upper and lower bounds of the set MM may or 
may not belong to this set. The upper and lower bounds of a section 
evidently coincide with its ends and always belong to it; on the other 
hand in the above example the set under consideration does not 
contain its lower bound (since it is not positive), nor its upper bound 
(since it is not rational). 


A set which has no upper limit cannot have an upper bound, 
for there is no number ( in comparison to which all numbers of the 
given set are smaller. For the purpose of analysis it is important to. 
note that a set with an upper limit always has an upper bound (and 
only one); similarly, a set with a lower limit always have a single- 
lower bound. The theorem on existence of bounds for bounded sets. 
(which is by no means self-evident) is one of the most important 
properties of continuum. It can readily be shown that, for example, 
the set in our last example has an upper limit, but that within the 
region of rational numbers it has no upper bound. 
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This theorem is proved in the same way for the upper and’ 
lower bounds so that we only need to prove one of these cases. 


Lemma 3 (on existence of bounds for bounded sets). The set: 
Msowhich has an upper limit has a single upper bound. 


Proof. Let us say that a section is normal if it contains at least 
one point of the set M, and to the right of this point there is no point 
of this set. It can readily be shown that from the two halves of a 
normal section at least one half will always be normal; in fact, if the 
right half contains at least one point of the set Jf, then this right half 
will evidently be a normal section; if, on the other hand, the right 
half contains no points of the set M, then the left half will be the: 
normal half. 


Let us assume that a is an arbitrary point of the set J, and & 
is an arbitrary number which exceeds all numbers of the set M. 
The section (a2, 6) = A, is evidently normal; let A, denote its 
normal half, Ag; the normal half of the section A», and generally, - 
An+ the normal half of the section A, (n=1,2...). Thesections. 
A;, &o,.--, An... form a contracting sequence, and therefore, 
according to lemma 1, they havea single point 8 in common. We 
now maintain that 6 is the upper bound of the set M. To begin. 
with, we must prove that there are no points of the set M to the right 
of 8; let us assume that « > 8 belongs to the set Jf; each section 
A» contains the point @; but if this is so, it must also contain: 
a, for if it were to end more to the left, then the point « of the 
set Jf would lie to its right, and it would no longer be normal. 
Therefore, each of the sections A, contains both points B and «, and 
therefore its length is not less than «—®; however, this is impossible,. 
since A, —>O(n— oo). Hence there are no points of the set M to 
the right of the point @. 


Let us now assume that ¢ isan arbitrary positive number; 
when 7 is sufficiently large, A, <¢; and since A, contains 6, 
all points of the section A, lie to the right of 8 — <¢; but since the 
section A, is normal, it does not contain a single point of the set M 
to the right of @ — «. Therefore, no matter how small « > Othereis a 
point belonging to the set M which lies to the right of B — ¢; this. 
means that B has also the second property of the upper bound and 
therefore it is, in fact, the upper bound of the set J7; existence of the: 
upper bound is thus proved. The fact that it is impossible for a 
given set M to have two different upper bounds is almost self-evident ; 
if there were two such bounds ~,; and By (By < {»), then it wouldi 
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-follow from the first property of the bound 8, that no number of the 
set Mf can lie between B, and B,, whereas, according to the second 
property of the bound B., there must exist such numbers which leads 
to the required contradiction. Lemma 3 is thus proved. 


§ 19. Final Points in Connection with the Theory of Limits 


In chapter II we constructed the basic theory of limits. How- 
ever, some of the more important propositions of this theory could 
only be established on a more accurate basis which we now have at 
our disposal after having studied continuum and its fundamental 
properties. In this section we shall, therefore in a Ways supplement 
our present knowledge of limits. 


1. To begin with, let us consider changes in the increasing 
bounded quantities within a widerscope. If a, belongs to an increas- 


ing sequence of real numbers bounded from above, then a lim an 
t=) 2 
n—> 0 


must exist; (this follows from the last theorem in § 17). But we know 
that a sequence of numbers is the only way to describe a mathe- 
matical process. If we are given an arbitrary process described by 
any method, we shall naturally say that the quantity « which parti- 
cipates in this process is an increasing quantity if for any two given 
moments of the process its value at the later moment is not less than 
its value at the earlier moment. We say that the quantity x has an 
upper limit in the given process if there is a aumber C, such that from 
a certain moment of our process onwards we always have x < C. 
It is evident that the increasing sequence with an upper limit, which 
we have considered at the end of § 17, is a particular case in the 
general system of increasing quantities with upper limits. We shall 
see that the theorem at the end of § 17, which was proved for this 
particular case, remains valid for our general system. 


Theorem 1. Lvery increasing quantity which is bounded from above 
has a limit. 


Proof. Owing to the fact that the quantity x is increasing, and 
bounded from above, there must be a number C such that always 
x < C; therefore, the set M of the values taken by + is bounded from 
above, and, in accordance with lemma 3 $18, it has an upper bound 
8. Let ¢ bea positive number which can be as small as we please. 
In accordance with the second property of an upper bound, there 
must be a number in the set M (i.e. « will sooner or later take this 
value) which is greater-than ® -- €; since x is an increasing quantity, 
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all its subsequent values will be greater than 8 —«. But it 
follows from the first property of an upper bound that no number of 
the set M exceeds 8. Hence from a certain moment onward we 
alway have: 


p —e <x < 6, 
_and therefore 
{x—Bl|l<s; 


but since the number < is as small as we please, therefore in this 
process x» 8. This proves theorem 1. 


It is evident that this theorem remains valid for a decreasing 
‘quantity which is bounded from below. 


We have so far said that x increases in the given process if its 
value x, at a later moment of the process is never smaller than its 
value x, at an earlier moment: x, > «,- Thus an_ increasing 
quantity either increases in the course of the process or maintains its 
‘former value but it never decreases; therefore, we can naturally say 
that this quantity is non-decreasing and reserve the term “increasing” 
for quantities for which we always have x, > x, with no possibility 
of equality. We shall use this terminology in future. Thus, for 
‘example, as x increases, the quantity 4x? also increases, but |x| (c.f 
§ 4, example 1) isa merely non-decreasing quantity. It is obvious that 
‘every increasing quantity is at the same time also a non-decreasing 
quantity, but the converse is not true. Similarly we say that x is a 
decreasing quantity if we always have x». <x, and that it is a non- 
increasing quantity if we always have «, <x,. All non-decreasing 
and all non-increasing quantities are called monotonic (they always 
change in the same direction). Hence, in general, theorem | can be 
stated as follows: a monotonic quantity which is bounded in the direction of 

its change always has a limit. 


2. Let us now consider a new problem. We have just shown 
that for a monotonically changing quantity, boundedness in the ap-. 
propriate direction serves as a sufficient condition for existence of a 
limit. In general, when a quantity does not change monotonically, 
it is often important to find if this quantity has a limit in the given 
process. A necessary and sufficient condition also exists for the 
‘general case, as we shall later see and is of great theoretical impor-. 
tance. We formulate and prove this condition for the general case 
as follows: 
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Theorem 2 (criterion for existence of a limit). Jn order that x 
should in the given process tend to a limit, it is necessary and sufficient that, no - 
matter how small the positive number z, from a certain moment of the process 
onwards, two arbitrary values of x should differ from one another by not less 
than ¢. 


Proof. We shall break up the condition of sufficiency into three 
stages. 


1. According to the conditions of the theorem, there will be a 
moment in our process after which two values of x will differ from 
one another by less than unity. If at the moment in question « = “9, 
then for all subsequent moments 


Xg~-lcxcxr,gt+ il. 


Hence the set J of values of x is, from that moment onwards, fully 
contained in the section A with ends x ) — | and x, 4+ |. 


2. Let us call any section & normal if, from an arbitrary 
moment of the process onwards, x takes values which still belong 
to the section 6 (this can be stated more briefly by saying that the 
normal section contains: values of « which can be “as late as we 
please’). It is evident that (1) the section A is normal, and (2) if the 
given section is normal, then at least one half of ‘it is also a normal 
section. This latter circumstance enables us to use the conventional 


method for constructing a contracting sequence of sections without 
the use of A 


A, Ai, Aa. +. Anyeees 


in which eacli section represents the normal half of the preceding 
section. ‘The common point of all these sections (which exists, as - 
shown by lemma ], § 18) is denoted by a. 


3. Let us prove, finally, that lim «=a. Let ¢« be an 
arbitrary positive number. Let n be so large that A, <4e. Let 
us fix a moment of our process so that from that moment onwards 
two arbitrary values of x differ from one another by not less than 
4. Since the section A, is normal, it contains a value x, which 
x takes after the moment in question. Hence for any value x2 taken 


after that moment, we have, as a result of the choice of that moment, 


lvg— x, | < fe. 
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But on the other hand, since both a and x, belong to the section A y, 
whose length is not less than }¢ we have 


[x,y —aj\ < fe. 


We find from the last two inequalities : 
ive —al<e; 


where < is an arbitrary positive number and x, an arbitrary suffi- 
ciently late value of x (which it takes after the chosen moment). But 
this means that lim v = a. 


Necessity of our condition can be proved very simply: if 
lin «=a, then for any two sufficiently late values x, and *, of x 
we have 


{41 —- al < fe, lv. —a|< fe, 


hence 
xy = Xe | <4, 
which was to be proved. 


The proved condition is very useful in theory, but for proving 
‘existence of a limit in individual examples it-is rather rarely used; 
this is due to the fact that in majority of examples, it is rather difficult 
to determine whether the requirements of this condition are satisfied.* 


We have proved the criterion for existence of a limit in very 
-general terms for processes of all types. Evidently when we are 
trying to apply this criterion to the mathematical structure of a given 
‘process, as we did in § 14, the general criterion gives us a definite 
‘condition in relation to the process of the given type. 


Let us now state other more important special conditions of 
this type. 

1. In order that the sequence of real numbers a), Qo, .. +5 Gn... 
‘should have a limit, it is necessary and sufficient that the following condition is 
satisfied : no matter what the positive number < be, there is a natural number 
ng such that| an —4m|<<¢forn > no, m> no. In other words, 


* This condition is often known as Cauchy's criterion; in general it is usual 
‘to use the term crilerion in connection with conditions which are simultaneously 


‘necessary and sufficient. : 
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any two “sufficiently far removed” terms of the sequence should. 
differ from one another as little as possible. 


2. In order that the function y = f(x) should have a limit for x >a, 
it is necessary and sufficient that the following condition is satisfied : no matter 
what the positive number & be, there exists another positive number 8 such that 
we always have | f(*1) — f(*2) |< for |x,y—a|< 8| x, —a| < &. 
(x; 4 a, 2a). In other words, the values of the function f(x«) at 

.two different points sufficiently close to a should differ from one- 
another as little as possible. 

3. In order that the function y = f(x) should have a limit as x 
increases indefinitely (x > + 00), it is necessary and sufficient that the 
following condition is satisfied : no matter what the positive number ¢ be, there: 
exists another positive number A scuh that we always have| f (x1) — f(*2)|\<« 
for x; > A, x, > A. In other words, the values of the function f(x) 
for two sufficiently large values of x should differ from one another: 
as little as possible. 


Finally, at the end of thc section on limits, we find it necessary 
to say that in order to acquire practice in the evaluation of limits, it is- 
necessary to solve many examples. Many instructive examples of” 
this type can be found in the Problem Book by B.P. Demidovich, in. 

‘which problem Nos. 38, 40, 41, 42, 48, 50, 50-58, 60, 68, 76, 109-112,. 
357-365, 376-380 (section I) are particularly useful. * 


—— 





* At the end of this book the numbers of these exercises are given as they> 
appear in thg second edition of the “Problem Book”’ by B.P. Demidovich. 


CHAPTER V 
CONTINUOUS FUNCTIONS 


§ 20. Definition of Continuity 


After the preliminaries we can now study the main problem of 
mathematical analysis, vz. the problem of functional dependence. 
But even now we must approach our subject systematically and 
isolate theoretically and practically some classes of functions which 
are of fundamental importance. Keeping in mind the history of 
development of our science it is advisable to consider at the beginning 
the class of continuous functions. ‘The concept of continuity, z.e. the 
continuous change of a function, can readily be visualized and we 
have already used this term on several occasions without having 
defined its meaning. We must now clearly define the concept of 
continuity and study the properties of continuous functions in detail, 
not only because we shall often encounter these functions in future 
but also because the study of other, morc complicated classes of 
functional relationships can frequently be reduced to the study of 
continuous functions. 


Let » = f(x) be a function which is defined along some section 
of the number line and let a be an arbitrary point on that line. The 
function f(x) has a definite value f(a) at the point a. Let us now 
go from the point a to another adjacent point a + A, where his a 
positive or negative number with very small absolute value. In 
connection with this type of transition it is customary to say that the 
quantity x whose value is a has received an increment h and thus taken 
a new value a + h; we have already said that the increment / can 
be either positive or negative. A new value f(a + h) of the func- 
tion f(x) corresponds to the new value a + hofx; the difference 
f(a + h) — f(a which corresponds to the difference between the 
new and old values of y is naturally said to be the increment of y which, 
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it has received in the transition of x from the old value a to the new 
value a + h; it is obvious that this increment can be either positive 
or negative (sometimes it may be zero}. In analysis it is customary 
‘to denote the increment received by a quantity x by the symbol Au. 
We can therefore say that if we have x = a, then the increment 
Ay =/f(a +h) — f(a of » corresponds to the increment Ax =h 
of x. Its geometrical meaning is represented in Fig. 10. 


If a remains unchanged while we change the increment A of x, 
‘then evidently the increment A y = f(a + h) — f(a) of » will also 
change ; a definite value of A» 
corresponds to each value of Ax. 
Let us assume that in a particular 
case the value of / tends to zero, 1.e. 
we assume that the new value of 
a+h of x tends to the old value a; 
if under these circumstances the 
increment Ay of the function 
y = f(x) also tends to zero, it would 
mean that for a sufficiently small 
change in the value of the quantity 
y will also change by as little as we 
Fig. 10 please. This is thc meaning of 
physical representation of the concept 
of continuity. Hence the essence of the concept of continuity is the 
factthat an infinitely smallincrement of the function corresponds to an infinitely 
small increment of the independent variable. Since the relation 


Ay=f(ath)—f(a) > 0 (Ax =h-> 0) 
‘is equivalent to the relation 
f(a + h) > f(a) (h -> 0), 


‘the definition of continuity can be formulated as follows : 





The function f (x) is said to be a continuous function at x = a (or “at 

the point a’’) if 
tla + h) >f (a) (A + 0). 

Hence it is necessary and sufficient for the function f(x) to be 
continuous at the point a that the value of the function f(x) should 
tend to a definite limit when x > a, and thatthis limit should be 
-equal to the value f(a) of this function at the point a. At the 
same time it is also important that the relation f(a + h) > f(a) 
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should hold irrespective of the path by which h approaches zero: by 
positive values, by negative values or withouta change of sign taking 
place; in other words, we should have f(x) > f(a) irrespective of 
whether x approaches the point a from right or left or whether it 
passes repeatedly from right to left and vice versa (the two-sided limit 
of a function, ¢f. § 15). 


The precise definition of the concept of liniit transitions which 
we have studied in detail in § 14 enables us to define the concept of 
continuity in another way which is often very convenient: the function 
Sf (x) ts said to be continuous at the point a if no matter how small < > 0 
thereisa & > O such that we have| f(a + h) — f(a) | < = for every h 
whose absolute value is smaller than 8. In other words, a function is 
continuous at a given point if a change of the function which can be 
as small as we please corresponds to a sufficiently small change of 
the argument. 


The majority of cases in which continuity of a function is 
violated at some point is due to the fact (fig. 11) that f (x) tends to 
a definite limit when x approaches a from 
right (i > 0) and tends to another 
definite limit when x approaches a from 
left (h <0) but these two limits do not 
coincide. In this case there is no single ‘\ 


limit lim f (x) and the function f/f («) is 
xa eT Met) 
discontinuous at the point a as can be « fla~0)\ j 
{ 
i] 


readily seen from fig. 11. The fact that x 

tends to a from right (i.e. by assuming a 

values greater than a only) is usually Fig. 11 
denoted symbolically as follows: x a+ 0; 

ifin this process f (x) tends to a definite limit, then this limit is 
denoted by f (2 + 0) so that 


f(a+0) =lim f(x). 
xr-at+0 


a eee 


ee 


The meaning of the symbols x > a — 0 is similar and 


f(a—0) =lim ff (x). 
x—>a—Q 
In the case considered in fig. 11 both limits f(a +- 0) and f(a — 0) 
exist but differ from one another. We know that it is necessary for 
the function f (x) to be confinuous at the point a that not only the 
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limits should coincide but also each limit should coincide with the 
value f (a) of the function f (x) at the point a (it is evident from their 
definition that the numbers f (a + 0) and f (4 — 0) must not nece- 
ssarily coincide with f (a) and are quite independent of it). Thus 
apart from the condition f(a + 0) #4 f (a — 0) which causes viola- 
tion of continuity in the example we are considering, this phenomenon 
may also be due to the influence of other causes, 77z.: 


(1) f (2 + 0) or f (a — 0) may not exist at all. Typical 
examples of this kind are the following: 


(x # 0), 


(a) JO) = 9° 
0 («= 9); 


J (x) increases indefinitely for x — + 0; the absolute value of / (x), 
which is negative, increases indefinitely for «> — 0; therefore 
S( + 0) and f(— 0) do not exist; the function / (x) is thus unbounded 
in the neighbourhood of the point 0. 


i fel J Se 
() Ce aaa ake 
0 (x = 0); 


f (x) remains bounded this time for x ~ + 0 (| sin 1/«] <1), but 
cannot tend to a limit, for it repeatedly takes the values + 1 and 
— 1 (orany value between + 1 and — 1); f(x) evidently behaves 
similarly for x > — 0; therefore f ( +- 0) and f( — 0) do not also 
exist in this case although the function f () remains bounded in the 
neighbourhood of the point 0. 


(2) It may happen that f (a + 0) and f (a — 0) exist and are 
equal to one another but differ from f (a) ; for example 


aa fe Oe SO), 
foy= fy (x = 0); 
here f(a + 0) = f (a — 0) for a = 0 while f (2) = 1. In all these 
cases the function f (x) is discontinuous (non-continuous) at x = a (at 
the point a). 


It is very important to remember that the definition of conti- 
nuity implies a local (7.¢. at a given point) property of a function; 
generally speaking, a function may possess this property at some 
points while it does not possess it at other points. The values of the 
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‘variable + for which the function f (x) is continuous are known as 
points of continuity of this function and points at which the function is 
discontinuous as points of discontinuity. In the examples of discontinuous 
functions, which we have considered above, the function is continuous 
everywhere except at a single point; the set of points of discontinuity 
of such functions evidently consists of this single point. It is quite 
easy to think of functions which have two, three, or more points of 
discontinuity and also of functions which have an infinite number of 
points of discontinuity. But, on the other hand, there are functions 
which do not have points of continuity at all and points of disconti- 
muity fill the entire number line. An example of this kind is given 
by the function D (x) which we have considered in § 4; this function 
is equal to zero or unity in relation to whether x is an irrational or 
rational number. Owing to the fact that every section of the number 
line contains an infinite number of both rational and _ irrational 
numbers, no matter what the number a be, there will be both 
rational and irrational numbers in its immediate neighbourhood : 
hence the function D (x) will take the value 0 and unity at points 
which can be as close as we please to the point a; it thus follows 
that D (x) cannot tend to a limit as x > aand it is therefore dis- 
continuous at « = a; and owing to the fact that a is arbitrary, the 


function D (x) is discontinuous everywhere; moreover, D (x + 0). 


and D (* — 0) do not exist for the same value of x. 


It is sometimes useful to distinguish the one-sided continuity of a 
function. The function f(x) is continuous to right, of the point a if 
f (a + O)exists and f (a + 0) =f (a); it is continuous to left if f (a — 0) 
exists and f (a — 0) =/f (a); in order that the function should be 
continuous at the point a it is evidently necessary and sufficient that 
it should be continuous to right as well as left of that point. 


We shall say that the function f(x) is continuous along the line 
{a, b) if it is continuous at every point of this line (i.e. it has no 
points of discontinuity on this line). In this case continuity to right 
of the end a and continuity to left of the end 6 of this line are only 
necessary ; this fact is obvious because the function / (x) is frequently 
defined only for points on the line (a, )) so that the question of its 
continuity to left of the point a (or its continuity to right of the point 
6) does not arise. The definition of a continuous function along a 
line does not alter our previous statement that continuity is a local 
property, for continuity along a line is defined in terms of continuity 
at every point and this is the primary definition in the theory of 
continuous functions, which implies a well-defined local character. 


‘ 


° 
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§ 21. Operations with continuous functions 


In chapter 2 we have studied the results of arithmetical opera- 
tions with infinitely small quantities, infinitely large quantities and 
quantities which tend to limits; we must now establish the fact that 
continuity of a function is, as a rule, conserved in the course of ele- 
mentary arithmetical operations. The importance of this problem: 
is self-evident, for its general solution will make it unnecessary to test 
continuity of every function obtained as a result of similar operations- 
with continuous functions. 


Let us assume that we are given the algebraical sum 
Se) =Sfi (*) fe (4) & «Ef n (4) 


of functions, each of which is continuous at x = a. According to the 
definition of continuity this means that f, (x) > fi (a), fo (x) >/fe (a), 
wesy Son (*) > fn (a) for xa; but in this case we know from. 


theorem 1 § 11 that 


fis) =fi@) + felt) t -. Aha ls) ofa (OD + fo @ + ... 
we t fn (a) = f (2) 


for « —-> a and this means that the function f (x) iscontinuous at the 
point a. 


By using a similar simple argument (with reference to theorem 
2§11) it can be readily proved that the product of an arbitrary 
constant number of functions which are continuous at the point a will 
also be continuous at that point; in particular, if the function f (x) 
is continuous at x = a, then the function { f(x) }* possesses the 
same property, where 7 is an arbitrary natural number. Division, on 
the other hand, usually requires some additional explanations. Let 
fi (x) and f2 (x) be two functions which are continuous at x = @ and 


let fo (a) fx 0. 


In accordance with our assumption /; (x) > f, (a) and Fw 
-> fe (a) for x = a; therefore it follows from theorem 7 § 11 that 
lim fy (x) 
lim Fi (a) igicieraaclereter™ Fi (a) 
xoa fo (x) lim fg (*) fe (a)’ 
x—-a 





which shows that the function /; (x) / f> (x) is continuous atx = a; 
Hence this rule applies provided that f. (2)s40. But iff, (2) = 0, 
then the expression fy (x) / f2 (x) is devoid of meaning for x = a and 
therefore continuity of the quotient has no meaning atall in this case. 
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All the rules which we have so far established remain valid if 
we consider a function which is continuous not at a single point but 
along the entire section of a line; this follows directly from the defi- 
“nition, given in § 20, of continuity of a function along a section. In 
the case of a quotient the result should evidently be stated as follows: 
if the functions f; (+) and f, (x) are continuous along a section of a 
line and if f, (x) does not vanish at any point on that line, then the 
-function f; (x) /f2 (x) is continuous along that line. 


$ 22. Continuity of a composite function 


Let » be a function of x, y = f(x), defined along some section 
-ofa line (a, 6). Let us denote by Jf the set of numbers which the 
‘function f(x) assumes by running through all the numbers on theline 
(a, 5). Let some third quantity z be another function of», z = v (), 
which is defined for all values of y belonging to the set Mf. When x 
takes a definite numerical value on the line (a, 4), then y = f(x) also 
takes a definite value which belongs to the set Jf; but in this case 
z =  (y) also takes a definite numerical value. Hence in the long 
run a definite value of z corresponds to each value of x along the 
section (a, 4); in other words, z is a function of « defined along the 
section (a, 6). It is convenient to denote this dependence as follows: 


=F [ f (x) | 
-or by two equations : 
ze= (9), gy =f). 


z is not directly defined in terms of the independent variable x but 
by means of an “‘intermediate’’ function »; z is defined as a function 
of y and » as a function of x; therefore z appears to be a function of 
x. A function which is given in this way is said to be a composite 
function (or a ‘function of a function”). 


Example. Let 7 = cos x, z = tog y; the function log y» is 
defined only for positive values and therefore we shall restrict our- 
selves to the study of those values of x for which y = cos x > 03 for 
-example, let — =/4 <* < + <=/4; then y > O and log» has a 
. definite meaning. We can write 


Tv 


io 
z == log cos x (-P << oF , 
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we know that this function is very important in the logarithmic solu~ 
tion of trigonometrical equations and detailed tables are published 
for this function. The following are some other simple examples : 


z=7*% yp=Ssmx, 2 = sin? a, 


1 


pe, BES) pee eat se | 
< 3 VYl+e are 


(both functions are defined for all values of x). 


These examples (like the definition of a composite function) 
show that the term “‘composite function”? describes no new class of” 
functional dependcncies but only a specific method of defining a 
function ; the simplest functions can be defined in composite form if 
this is desirable; thus the function z = x4 can be defined with the 
help of the relations z = »*, y = x? and when given in this form it 
becomes a composite function. 


It is obvious that the form in which a function is defined can 
be even more composite—it may contain not one but two or more- 
intermediate functions. 


Example: The function v = log(] + 1 + x*) can be given 
in terms of a chain of relations v = logv, u=1+2,2= Vy, 
y = 14+ +7, ie. it may contain three intermediate functions w, z 
and y. 


Let 2 = 9(9), 7 = f(x) and let the function /(x) be defined and. 
continuous along the section (a, 6), while the function o(y) is defined 
and continuous along another section which includes all values of the - 
function f(x) for @ <x <b. We will prove that in this case the 
composite function z= 9[ (f)] is also continuous along the line (a, d). 
Let « be an axbitrary point onthe line (a, 6), and let f(«) = 8; since. 
the function f(x) is continuous along the line (a, 6), we have : 

lim (f)x = f(«) = 8; 

Na 
and, on the other hand, the function ¢ (y) isassumed to be continuous . 
for y = §; it therefore follows from f(x) -> @ that 


elf(sl> eo) =9Lf@] @>e4), 


which proves continuity of the composite function ¢[f(+)] at the point 

a#;and since %is an arbitrary pointon the line (a, 2), the function 9 [ f(x)], 

must be continuous along the whole line. We have thus proved the- 
following theorem. 
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Theorem 1. Jf the function f (x) is continuous along the line (a,b) and 
the function 9 (y) continuous along another line which contains all values of the 


Junction f(x) along the line (a, 6), then the composite function p[ f(x)] is 
continuous along the line (a, 6). 


In other words, if botli functional dependencies whica make a 
composite function are continuous, the composite function will also 
be continuous. By means of simple induction it is easy to apply this 
theorem to composite functions defined in terms of three or more 
links : if in each link the dependence is continuous, then the resulting 
composite function will be a continuous function. In practice we 
always come across composite functions, each link of which is composed 
of some elementary function (cf. §6). It would indeed be very 
difficult to prove in each case the continuity of each combination of 
elementary functions which we may encounter. Theorem | enables 
us once and for all to dispense with this necessity: if we can prove 
continuity of a small number of the simple elementary functions 
(and we shall do this in § 24), then it follows from theorem | and from 
the theorems in §21 that every finite combination of these simple 
functions will be continuous (7.e. every such combination composed of 
the simple elementary functions by means of arithmetical operations 
and operations involved in constructing a composite function, which 
can be repeated an arbitrary finite number of times in any order). 


§ 23, Fundamental properties of continuous functions 


Continuous functions have a series of properties which make 
their study and application much simpler than is the case with non- 
continuous functions. We shall now state and prove several important 
properties of this kind. But, to begin with, we must establish an 
auxiliary proposition which we shall find very useful in future. 


Lemma. The function f(x) whichis continuous and positive for x = a 
will also be positive along some line which contains the point a. 


. . . . e 
Proof. Asa result of continuity of the given function at the 
point a we have: 


I) efK(Q  (*> 4); 


and therefore it follows from f(a) > 0 and theorem 2 § 10 that 
S (x) > 0 provided « is sufficiently close to a; this proves the statement 
of the lemma. 
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Obviously it is possible to prove by the same method that if 
f(a) < 0, we should have f(x) < 0 for all points on some line which 
contains the point a. 


In future we shall say that the function f(x) defined along the 
line (a, 6) is bounded along that line if its values along the line (a, 5) 
form a bounded set. 


Theorem 1. The function f(x) continuous along the line (a, 6) is 
bounded along that line. 


Proof. Let « be an arbitrary point on the line (a,b). The 
function f(x) is continuous at the point «, and therefore | f(x) — 
—f(«)| < 1 provided x is sufficiently close to «; hence a line 8, 
exists with « as its centre such that for an arbitrary point x on the 
line 5 *) we have | f(x) — f(«)| < 1; therefore 


IF (#)| <1 fF (@)| +1. 


We can construct a line 5, for every point « on the line (a, 5). 
The system S' of all the lines so constructed evidently covers the line 
(a, 6). In accordance with the theorem on finite coverage (lemma 2 
§ 18) a finite group of lines Ay, As, .., An of the system S exists 
which also covers the line (a, 0). Each one of the lines A, is one 
of the constructed lines 5, (k=1, 2, ..., 2); therefore for any point 


zx on the line A, we have 


lf x) | <| flee) | +1; 


If we denote by v the smallest number among n numbers | f («;) |, 
| f (a2) |...» | (@n) | and keep in mind the fact that any point x on 
the line (a, 5) belongs to at least one of the lines A,, then we have 
for any point % on the line (a, 5) 


If(*)l<u+ il. 
This proves that the function f (x) is bounded along the line (a, 0). 


Theorem 2. The function f (x) continuous along the line (a, b) takes 
tis minimum and maximum values on that line. 


Preliminary note. It follows from the above theorem that the 
function f (x) is bounded along the line (a, 5) ; it follows from lemma 





*) It is obviously assumed that x lies on the line (a, 6) ; if the point « coincides 
with one of the ends of the line (a, 5), then the inequality | f(x) — f(a) | <1 must 
only be satisfied for those points x on the line §¢ which lie on the line (a, 6). 
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3 § 18 that the set J of values taken by the function f (x) along the 
line (a, 5) has therefore a lower bound « and an upper bound 8. We 
know, however, that the bounds of a bounded set must necessarily 
belong to it; hence in the case under consideration « and B may or 
may not belong to the set Jf, t.e. they must not necessarily be values 
which the function f (x) takes along the line (a, 6). This may be 
quite possible for non-continuous functions ; let us assume, for example, 
that 


2 4. ee 1), 


if « < 1 and is sufficiently close to unity, then the function f (x) will 
also be as close to unity as we please; the upper bound 8 = 1; 
however, at no point on the line (0, 1) do we have f{x) = 1, and so 
everywhere f (x) < 1. Theorem 2 tries to establish the fact that 
this position is impossible for a continuous function : here the upper 
and lower bounds of the set M are always the maximum and 
minimum values, respectively, of the function / (x) along the line 
{a, 6); in other words, a point x, can always be found on the line (a, 5) 
such that f (4) = «, and another point 2, such that f (x2) = 8. 


Proof. We shall give the proof only for the upper bound 8, as 
the argument is exactly the same for the lower bound. Let us assume 
that f(x) <8 at an arbitrary point x on the line (a, 8) and let us 
try to arrive at a contradiction. Owing to the fact that the function 
& — f(x) is continuous and does not vanish on the line (a, 4), it 
therefore follows from the last result of § 21 that the function 
1 / {8 — f(x} is a continuous function and, as a result of theorem 1, 
it is bounded on that Hine. Thus a number C' > 0 exists such that 


1 
=: te eee, 
Bf (2) 
and consequently 
] 
F(x) <B—-—~ (agx <A). 


Cc 


Since C is a constant positive number, this contradicts the defi- 
nition of the upper bound, according to which values of f(x) can be 
found on the line (a, 6), which are greater than 8 — ¢ for arbitrarily 
small c > 0. This contradiction proves theorem 2. 
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Theorem 3. /f the function f(x) is continuous on the line (a, 6) and 
if Y denotes an arbitrary number between f (a) and f (b), then a point c can be 
found between a and b such that f (c) = Y. 


Preliminary note. Theorem 3 expresses that property of conti- 
nuous functions which forms in our visual representation the esseuce 
of the continuous change ; in passing from one value to another a 
continuously changing quantity must inevitably run through all 
intermediate values without omitting any of them. 


Proof. At first let us consider the particular case when f(a) 
and f(6) have opposite signs and Y = 0 (i.e. we will show that 
when a continuous function changes from positive to negative or vice 
versa it must pass through zero). Let us assume that f (x) does not 
vanish anywhere on the line (a, 6) and let us thus try to arrive at a 
contradiction, Let us agree to call an arbitrary section of a line 
normal if the function f (x) has opposite signs on its ends : it is evident 
that out of two halves of a normal section one, and only one, will 
always be normal (let us recall that according to our assumption 
J (*) does not vanish anywhere). It is given that the line A, = (a, 6) 
is normal; let As be the normal half of Aj, A 3 the normal half of 
Az, and so on. The lines Aj, Ag, ---; Any. form a contracting 
sequence and therefore have a point in common which we can denote 
by ¢. According to our assumption f (c) ~ 0: therefore either 
f() > Oorf(c) <0. Let us assume that f(c) > 0. Hence asa 
result of the lemma established at the beginning of this paragraph 
we should have f (x) > 0 for all values of x sufficiently close toc: 
however, this contradicts the fact that the point belongs to the 
normal section A, which can be as short as we please and hence in 
the immediate neighbourhood of the point ¢ another point can be 
found (one of the ends of the section A,) where f(x) <0. This 
proves the particular case of theorem 3. 


Let us now consider the general case and assume that f (x) 
— Y = ¢ (x). According to the conditions of the theorem Y lies 
between f(a) and f (4); therefore 9 (a) and ¢ (6) have opposite signs. 
And since both f (x) and ¢ (x) are continuous functions, it follows 
from the particular case proved above that a point c can be found 
between a and 4 such that 9 (c) = 0 or, which comes to the same 
thing, f (c) = Y. This proves theorem 3 completely. 


Let us now assume that the function y = f(x) isa continuous 
increasing function on the line (a, 6); this means that we always 
have f (x1) <f (xq) fora <a,< x, <b. Let f(a) =a, f(s) =B 
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(« < 8) and let Y be an arbitrary number lying between « and 8. 
According to theorem 3 a number ec exists (a < ¢ < 6) such that 
JS (c) =; since the function f(x) is an increasing function, the number 
¢ must evidently be unique; thusa definite number ¢ on the line (a, 4) 
corresponds to every number Y on the line (#, 8); in other words, a 
single definite value of x on the line (a, 5), for which y = f(x), 
corresponds to every value of » on the line («, 3); hence x is a func- 
tion of y and is defined on the line (z, 8) : 


x= 9(3) (%* <7 <8); 


and it is evident that 9 («) = a, o (8) = 6. The function . = 9 (9} 
is said to be inverse of the function 7 = f (v); these two functions 
essentially express the same functional dependence between x and y 
and differ from one another only by the fact that one quantity is 
taken as the independent variable while the other is the function. 


Example i. y= x°9(— co <x < + @); the inverse func- 
tion isx = 3/y(-—-20<y< + @). 

Example 2. y = sin x (0 < * < x/2); the inverse function is. 
x = aresiny (0 <y < 1). 

Let us now prove that a function which is inverse of an increas- 


ing continuous function is also continuous along the corresponding 
line. 


Theorem 4. Let the function y = f (x) be an increasing continuous 
function on the line (a, 6) and let f (a) = «, f (6) = 8; then the inverse 
function x = ¢ (y) will also be continuous on the line («, ). 


Proof. At first let us assume that Y is an arbitrary interior 
point on the line (#8); let ¢ (¥) = ¢ so that a<e¢< 6 and 
fc) = ¥. Let <> 0 be so small that the numbers ¢ — < and¢ + € 
lie on the line ( a, x). Assume that 


f (¢—2) =" J(C+e)=%e, 
so that ¥; <Y¥ <Yz, and denote by § the smaller of the differences 
Y i? V1 Yo as Y. 


Let us now assume that] 7 — ¥| < 8; in this case evidently 
Y¥1< 39 < ¥, and therefore 


g(%1) <9) < 2 (Ya); 
but 9 (V1) = ¢ — ¢, 9 (Ye) = ¢ + ¢ and consequently 
c-—e<o(y)<cte, 
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or what comes to the same thing, | e (vy) — ¢| =| ¢ (y) — 2 (Y)| <<. 
We have thus proved that |y — Y | <5 implies that | 9 (y) — 
@ (Y) | <<; since ¢ > 0 can be as small as we please, the function 
@ (y) is continuous at the point Y, which was to be proved. 


In case Y = «or Y = B, the same arguments can be used to 
establish continuity of the function 9 (y) to right (at the point %) or 
to left (at the point 8). 


It is obvious that the theorem is also valid for a decreasing con- 
tinuous function f (x). 


In § 20 we repeatedly emphasized the local character of our 
concept of continuity; we said that continuity applies at every indivi- 
dual point so that, generally speaking, a function can be continuous 
at some points and discontinuous at other points. We have then 
defined continuity along a line as continuity at every point on the 
line. However, it is possible to define continuity along a line 
‘directly without using the concept of continuity at a point. In doing 
this we shall also use the basic idea that the essence of continuity is 
due to the smallness of changes of the function when the independent 
variable undergoes small changes. 


We shall say that the function f(x) is uniformly continuous along 
the line (a, 5) if the absolute value of the difference of its values at 
two sufficiently close points on this line is as small as we please. More 
accurately : we say that the function f (x) is uniformly continuous along the 
line (a, b) if the following condition is satisfied : no matter what < > 0 be, 
there exists a § > O such that for two points x, and x.» on the line (a, 6) 
which have a distance | xy —*_| < § we have | f (x1) — f (%2)|<s. We 
‘say in this definition that continuity is uniform because the difference 
| f (1) —/f (*2) | should be small irrespective of the positions of the 
points x, and x, on the line (a, 5), provided these points are situated 
close to one another. 


The concept of uniform continuity is very important in mathe- 
matical analysis. We must therefore establish right from the beginning 
the relationship between this concept and the concept of continuity 
along a line which we have defined earlier. It is almost self-evident 
that uniform continuity of a function along a line implies its conti- 
nuity at every point on that line and hence also its continuity along 
this line in accordance with our earlier definition. In fact, if the 
function f (x) is uniformly continuous along a line and if « is an 


arbitrary point on that line, then the difference | f (x) — * («) | will 
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be as small as we please provided x is sufficiently close to «, and this 
implies continuity of the function f (x) at the point «. It iseven more 
important to note that the converse theorem also holds : the fact that 
a function is continuous at every point of a (closed) line is sufficient for 
it to be uniformly continuous along this line. Thus our new defini- 
tion of continuity appears (for closed curves) to be totally equivalent 
to our former definition (of local character). 


Theorem 5. The function f(x) continuous at every point of the line 
(a, b) ts uniformly continuous along that line. 


Proof. Let « be an arbitrary point on the line (a, 5) and let. 
¢ be an arbitrary positive number. Since the function f (x) is con- 
tinuous at the point «, therefore for a sufficiently small $4 > 0 we- 
have for any point x *) on the line (a — 8,, a + 8g) 


FQ —F@) <> 


therefore if.x, and x, are two arbitrary points on the line (« —8,,. 
% + §,), then 


f(%1) — J (%2) |< (1): 


The same construction can be repeated for every point « on the 
line (2, 6) and we can say that the section (« —46,,%+45,), 
which comprises of one half of the section constructed above is the 
‘“‘proper section”’ of the point «. The set S of all such “‘proper sec- 
tions’ evidently covers the whole line (a, 6); according to the- 
lemma on finite coverage (lemma 2§ 18) a finite group Aj, Az, 

., An can be chosen from these ‘“‘proper sections’, which will: 
also cover the line (a, 0). Let us denote by 8 half the length of the- 
shortest of the sections A,;, Azg,;+-+, An: 


Let us now assume that x, and x, are two arbitrary points on 
the line (a, 6) with a distance not greater than 5. The point x, like 
every other point on the line (a, 4), lies on a section Az; but Ax is. 
one of the sections of the system S$ and is therefore a “proper 
section”’ («--4 8, & + $5,y,) of a point « on the line (a, b); therefore- 
|e, — «| < 45 ; but on the other hand 


leo —um| <8 <48a, 


*) We are obviously only considering points x which lie on the line (a, 4), for~ 
the function f (x) may be undefined outside this line. 
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where the above inequality follows from the definition of the number 
8. Hence the two numbers « and x, have a distance not greater than 
4 Sg and consequently 


[xo —%| < 8y. 


It therefore follows that both points x; and x, lie on the line 
{« —8y,a + 8,4) and the inequality (1) holds; but «, and 2, are 
two arbitrary points which have a distance not greater than § ; hence 
uniform continuity of the function /( +) along the line (a, 6) has been 
established. 


Note. We are assuming, as always, that the line (a, 6) which 
-we have considered in theorem 5, is aclosed line, z.e. it contains both 
its ends. For open lines (which do not contain their ends) theorem 5 
is, generally speaking, ‘not valid. Thus, for example, the function 
JS (x) = 1/« which is continuous at every point of the open line (0, 1) 
is not uniformly continuous along that line; in fact, for any small 
§ > Oand assuming that x, = 5, x, = 28, we have | x, — *2| =8. 
| f(a) — f(*¥2) | = 1/8 — 1/(28) = 1/(28); although |x, — x2 | 
-can be as small as we please, | f(x) — f(x2) | is as large as we please. 
“The function f(x) = tan x behaves similarly along the open line 
{— 72/2, + 2/2). In both cases we are dealing with unbounded 
functions. The function sin 1/ x, considered in § 20, is continuous at 
every point on the open line (0, 1) and is evidently bounded along 
that line ; however, it is not uniformly continuous, for the numbers 
, and x, exist and can be as small as we please (and therefore also 
as close as we please), for which sin 1 /x, = 1, sin 1/x, = — 1. 


§ 24. Continuity of elementary functions 


We shall show in this paragraph that all elementary functions 
are basically continuous (ze. with the exception of some easily 
‘distinguishable points). 


1. Theorem 5 $11 maintains that every polynomial P (x) is 
continuous for every value of x. Similarly the corollary of theorem 7 
in the same paragraph states that every rational fraction P(x) / Q(x) 
is continuous for every value of x provided its denominator does not 
vanish. Hence all rational functions are essentially continuous. 


2. Let us consider the exponential function » = a* and assume 
thata > 1. Since 
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therefore in order to prove continuity of the function a” for every 
value of x it is sufficient to show that 


a®*—1—+0 (kh- 0). 
For this purpose we must at first note, that Newton’s binomial 
(P+ay"=14+nA+..., 


where A > 9 and n is an arbitrary natural number, gives *) for 
ce Me 


(lh A">1+4nA, 


hence 


ye EMAL 
n 
Assuming that h > 0 and A = a” — | in this inequality we find : 


ah—1<2-—— = (h> 0,2 >1). (1) 


Let us now choose the number n such that 


ns ae <n+]; 
h 
when nh «1, a"* <a for a> 1; hence the function a@* is an 
increasing function (cf. § 17) ; it therefore follows from (1) that 
1 


as 
qg—r< 5 
n 


.and since evidently n > « for 4 > 0, therefore, 
a*’—1—>0 (h-0), 


‘which was to be proved ; thus all exponential functions a® are continuous 
_for every value of x. 


3. We saw in § 17 that the function a* is always monotonic 
for a > 0 **): it is an increasing function for a > 1 anda decreasing 
function for a< 1. We have already proved continuity of this 
function; a single inverse of the function a* must exist and it follows 
from theorem 4 § 23 that this inverse function must also be continuous 





*) we saw this already in example 3 § 7. 
**) A function is said to be monotonic if it is either non-decreasing or non- 
increasing along the given line (which can be the whole real axis). 
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along the half line x > 0. This inverse function is the function 
log a*. Hence all logarithmical functions are continuous. 


4. Since an exponential function is monotonic, it follows that. 
every power function x«* is continuous for every constant index « 
along the half line x > 0. In fact, let us assume that » > O and let 
n be an arbitrary integer greater than x We have: 


(e+ aye — a8 = wel (1 +—)°-1] (2). 


Let us assume that h > 0. Since an exponential function is mono- 
tonic, we have 


r<(it+ 4)" < (1 +4)" 


( we are, of course, assuming that x > 0); (1 + A/x)" isa polyno— 
mial in A and it evidently tends to unity for h— 0; therefore it. 
follows from theorem 10 § 11, that for h > 0 


(1+ es 1. 


hence from (2) 
(x +t h)*—x*->0 (h- 0), 


which was to be proved. Thus every power function x* is continuous: 


forx > 0*). 


5. It is very easy to prove continuity of the functions sin «andi 
cos x along the whole number line. Jn fact 


sin (x + h) — sin x = 2 cos (« + +) sin 4, 


where the last factor, and therefore the right-hand side as a whole,. 
tends to zero for h > 0; the proof is similar for cos x. Finally the: 
functions tan x, cot x, sec x and cosec x are expressed in terms of 
ratios of functions such as unity, cos x and sin x; hence ail’ 
simple trigonometrical functions are continuous at all points for which they- 


are defined. 


: aera : a 109m : 
*) If the function « ~ is written in the form e eit’ can readily be seens 
from theorem 1 § 22 that its continuity follows directly from continuity of expo-- 
nential and logarithmic functions. 
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6. The application of the theory of inverse functions (theorem 
4 § 23) inevitably Jeads to the conclusion that all inverse trigonometrical 
Junctions are continuous within appropriate regions. Let us consider, for 
example, the function arcsin «; since the continuous function sin x is 
monotonic along the line ( — 7/2, + 7/2) and increases from — 1 
to + 1, its inverse function is also monotonic and continuous along 
the line (— 1, + 1) and increases from — 7/2 to + x/2; and this 
inverse function is no other than arcsin x. 


This concludes the proof of continuity for all simple elementary 
functions. We know (§ 6 ) that all other elementary functions can 
be obtained from these functions as a result of finite number of 
algebraic operations; since all these operations are performed with 
continuous functions, therefore, according to the theorems in § § 21-22, 
they result in other continuous functions; this establishes the fact 
that all elementary functions are continuous everywhere except at 
isolated points whose positions can be determined in each case from 
the analytical expression of the function in question. 


Example. ‘The function 


is continuous everywhere except (1) at the point x = 1 and (2) at 
points x for which 


eas | = (2k + 1) 7? 


x” 


where & is an arbitrary integer, 7.e. at points 
<2 A2R de _ ete, : 
x= Ka te 2 eS eg Spc OT eyes 
hence continuity is violated only at points where the analytical 
expression of the given function becomes void. 


The reader will be able to find exercises relating to Chapter 5 
in the Problem Book by B.P. Demidovich, Section I, § 7. We recom- 
mend problem Nos. 490-501, 515-518, 544, 566, 568; the choice of 
other exerciscs is left to the teacher. 


CHAPTER VI 
DERIVATIVES 


§ 25. Uniform and non-uniform variation of functions 


When we study variation of functions in practice we are most 
interested in the problem of speed, i.e. in the rate at which the pheno- 
menon in question changes. The velocity of movement of a railway 
carriage or an aeroplane is the main index of its activity. The rate of 
increase of population of a town is one of its main lively characteris- 
tics. A road which rises from lower to higher places can be more or 
less steep in relation to the rate with which its gradient rises. 


The fundamental concept of speed is self-evident. However, 
for the solution of a majority of practical problems this general con- 
cept is insufficient. It is necessary to have an accurate quantitative 
definition for this quantity which we call the rate of change of the 
given phenomenon. However, when trying to form sucha definition, 
we find that the methods of elementary mathematics are insufficient 
and only adequate for a few simpler cases. Generally speaking, this 
problem can only be solved satisfactorily with the help of some mathe- 
matical methods and concepts which we shall now study. In the his- 
torical development the general necessity for the accurate definition of 
the rate of change of quantities and establishment of a unique method 
for evaluation of this rate led to the development of the science 
which we call mathematical analysis. An extensive branch of 
mathematical analysis is devoted to the solution of this problem and 
its consequences, ‘This branch is usually known as differential calculus 
and we shall now begin its study. 


Let us assume that y is a function of (the independent 
variable) x : 


y =f (x). 
98 \ 
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The change (increment) Ax of x leads to a definite increment 
Ay =f(e + Ax) —f (x) (1) 


of y. This increment can be very diverse in relation to the initial 
value x of the independent variable and the nature of the function 
J (x) which expresses the functional dependence in question; in other 
words, it can readily be seen from (1) that the increment A_y, apart 
from the increment Ax, also depends on x and on the form of the 
function f (x). We naturally assume that y changes quickly if |A_y| (for 
a given Ax) is large, and slowly if it is small; if Ay = 0, then y does 
not change at all as the independent variable x passes from x to 
XbA. 


Let us now consider the simple case when the change A y of 
y is always proportional to the change Ax of x, i.e. Ay = “An, 
where « is a constant independent of x and Ax. If Ax = 1, then 
Ay =a, te. the change of x by a unit (of this quantity) always 
corresponds to the same change Ay = « of y irrespective ofthe initial 
value x of the independent variable. If x denotes time, then »y 
changes by the same Quantity « during every unit of time (for example, 
during every second) irrespective of the moment x when we began to 
count. In other words, during the whole course of the process y 
undergoes the same change « in every unit of time. We can thus 
clearly see that in this case changes in y are not accelerated or re- 
tarded in the course of the process but always take place at the same 
rate, 7.e. we say that y changes uniformly. It is evident that changes 
of this type occur very frequently and therefore this is one of the 
most important cases; it is of the greatest significance in all that 
follows and we must therefore consider it in great detail. 


Let us assume that y = f (x) changes uniformly and let 
y =f (a) = 6 for x = a; in that case we have for every x 


J (x) — f(a) = «(x — a), 


and therefore 
f(s) sax + f(a) — 9a = ax + 8, 


where 8 = f(a) — vais aconstant. Thus every uniformly changing 
quantity y = f (x) represents a linear function (a binomial of the 
first degree) of x : 


y = ax + B. (2) 
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Conversely, if y =f (x) is connected with the independent 
variable « by the relation (2), then 


Ay =f (wt Ax) —f (0) =[u (e+ Ax) +B] — [ex + plaaax, 


i.e. Ay is proportional to Ax and y changes uniformly. Thus all 
linear functions, and only linear functions, change uniformly; this 
clearly shows that uniform change of functions is a very restricted 
particular case. 


If x denotes the time which elapsed from a certain initial 
moment and y denotes the distance of the moving body at the 
moment x from a certain initial position, then the increment Ay of 
this distance for Ax = I evidently denotes the path covered by the 
body in unit time (for example in one second). If y changes 
uniformly, the body would travel the same distance in every second ; 
if this distance is «, then, as we know, y = «x + 6, where Bisa 
constant, In physics this type of movement is called uniform and the 
path « covered by the body in unit time of uniform motion is said to 
be velocity of this uniform motion. 


Similarly in the general case, when x and » are representing 
arbitrary quantities, the uniform change of the function y = f(x) 
means that the change in x by one unit causes an increment in y 
equal to one and the same number «; we naturally assume that in 
this case the number « also measures the velocity of change of 
y (in relation to x). Hence the definition of velocity of a uniformly 
changing function causes no difficulties; if such a function is written 
in the form y = «x -+ B, then « is the (constant) rate of its change. 
a can be positive, negative or zero. If « <0, then Ay <O for 
Ax > 0, t.¢. as x increases, y decreases. This case is obviously 
quite possible. Thus in the case of uniform movement which we 
have considered above y can denote not only the distance of the 
moving body from some initial position but also its distance from its 
final position which it approaches. In that case y will evidently 
decrease in the course of time, 7.e. we shall have Ay < 0 for 
Ax > 0. When « = 0, we have y = 8; thus y remains constant in 
the course of the process ; this means in our mechanical example that 


the body remains at rest, z.e. the velocity of its movement is cqual to 
zero. ; 


It is obvious that if a function changes non-uniformly, i.e. if 
the increment of the function acquired for every unit increment of 
the independent variable is different at different moments of the 
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Process, we cannot so simply define the rate of change of the 
function, But we can then forecast that in this case the rate of 
change of the function for any feasible definition of the function will 
be different at different moments of the process, 7.e. it will be a local 
phenomenon, where the word “local” has the same meaning as in the 
last chapter. 


§ 26. Instantaneous velocity of non-uniform movement 


Let us assume that are we interested in the problem of velocity 
with which a given car moves at a given moment. This question is 
often answered as follows : “velocity of the car is 40 km per hour’, 
But what does this mean? Can it mean that the car travels 40 km 
per hour? But we are really interested in the speed of the car ata 
given moment, since in the course of one hour the car will probably 
change its velocity many times by accelerating and retarding ; and 
if we know that during one hour it travels 40 km, this does not tell 
us anything at all about the velocity with which it moves now, at this 
instant. 


It may be argued that problem of instantaneous velocity is 
unimportant and that it is only important to know the total distance 
travelled by the car in one hour. But this is not true. Let us assume 
that the car crosses a bridge and a street sign shows that the speed 
limit must not exceed 10km. per hour. A policeman stops the driver 
and fines him for exceeding the speed limit : it appears that the car 
travelled with the velocity of 20 km per hour. But how do we know 
this? Who knows the distance covered by the car during the last 
hour? It is obvious that in this case it is quite unimportant to know 
the distance the car covered or is going to cover during a given 
time interval; we only need to know its velocity now, at this instant. 


If the speed of the car is uniform, i.e. if it always travels with 
the same velocity, the assessment ‘40 km per hour” fully describes 
its velocity which is one and the same at every moment of its move- 
ment. But the car does not move uniformly; during an hour its 
velocity changes many times and when we are told that the car 
covered a distance of 40 km in one hour, this only gives us an 
impression of average velocity of the car at a particular moment at a 
particular place on its route. An hour is rather a long time interval 
during which the velocity of the car may change many timcs. 


This will evidently make us choose a smaller time unit than an 
hour, for example one second. If we assume that during one second 
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our car covered 20 m, then is that not a sufficient indication of the 
velocity of its movement, say, during the beginning of that second ? 
It is obvious that in this case the position is much better : as a rule a 
car will not change its velocity many times during one second and at 
different moments of this second it will move with more or less the 
same velocity; therefore, in all probability we may consider the 
average velocity of the car in onc second to be a good approximate 
assessment of its “instantaneous” velocity of movement at every 


instant of that second. 


This, then, is the state of affairs with a rough object like a car. 
However, in physical and technical problems various more accurate 
cases are met with, when during one second a moving body is able 
to change its velocity more frequently and within much wider limits 
than a car is able to do within an hour. Just imagine one of the 
minutest particles of matter, an atom or an electron, which is 
subjected to milliards of collisions every second, each of which 
radically affects its velocity. It is obvious that for such a minute 
particle a second will be an enormous historical era in its life and 
that the path covered by the particle during one second will tell us 
nothing about the speed with which the particle moved at a given 


moment. 


We must therefore study the problem from a general point of 
view and we are now ready to do this. Let us denote by ¢ the time 
which elapsed from a certain chosen instant, which will be the same 
once and for all, and bys the path covered by the moving body from 
the initial instant until the instant ¢*). A definite value of s corres- 
ponds to every value of ¢ so that s is a function of ¢: 


s = fit). 


This equation is usually called the law of motion of the given body; 
we shall assume that we are already familiar with this law. 


The problem in which we are interested is as follows :how can 
we find the velocity of a moving body at a given instant of time ¢ 
from the knowledge of its law of motion? Before we try to solve 
this problem, we must make a very important methodical remark 
which is necessary for correct understanding of the given problem 
*) For the sake of simplicity it is useful to assume that the body moves along 
a straight line; however, all that follows remains valid when much wider assuamp- 
tions are made. ee 
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and which will be equally applicable to a great majority of practical 
problems which we arc going to consider in future. 


In a majority of ordinary problems when we are trying to 
evaluate some quantity (the square root of a quadratic equation, the 
length of a side adjacent to a right angle in a right-angled triangle, 
etc.) we know well in advance the nature of the required quantity, 7 ¢. 
we know its gcneral definition; we only need to evaluate its numeri- 


cal value or its symbolic expression, depending on the character of 
the given problem. 


In this case the position is completely different : what do we 
mean by the velocity of a moving body at the given instant ¢ — we do 
not know this, we did not define anywhere its meaning; it may at 
first appear that the problem in question is insolvable; how, in fact, 
should we proceed to evaluate a quantity about which we do not 
even know what it represents and defines? In order to make our 
problem feasible and soluble we consider it to be a double problem: 
(1) we must establish an appropriate definition for instantaneous 
velocity and (2) we must find a method for actual evaluation of this 


quantity. We shall then see that the same argument answcrs both 
questions. 


We shall later see that this logic is characteristic of many prob- 
lems in geometry and mechanics which can be solved with the help 
of mathematical analysis. 


Let us now solve our problem. Apart from the instant é for 
which we want to determine the instantaneous velocity let us con- 
sider another later instant ¢-+ At. During the time interval At 
which elapses between these two instants the body evidently travels a 
distance As =f (é + At) — f(t) equal to the increment of the 
function f(t) which corresponds to the increment At of the indepen- 
dent variable. We can therefore say that during the time interval 
At which elapses between the instants ¢ and é + Aé the average dis- 
tance covered by the body in unit time (for example, in one second) 
is equal to: 


A Oe ADS), (1) 
Ai Ai 


This relation is known as average velocity of the body between the 
instants ¢ and ¢ + Af. But does it tell us anything about the 
instantaneous velocity of the body at the moment ¢? If Ad is large, 
then during this time interval the velocity of the body can change 
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a 


many times within wide limits and therefore we are unable to judge 
the instantaneous velocity of the body at the moment / from the 
knowledge of its average velocity. But when At is small we can 
assume that during this time interval thc velocity of the body will not 
change greatly and the body will move with a pproximately the same 
velocity at different moments of this time interval; therefore the 
average velocity of the body during this time interval gives a good 
indication of the approximate instantaneous velocity of the body at 
the instant ¢ We can say more accurately that the closer is (1) to 
the velocity of the body at the instant ¢ in which we are interested, 
the smaller is the increment At; and even more exactly: we can 
consider (1) to be as close as we please to the required velocity of the 
body at the instant ¢ provided the time interval Af is sufficiently small, 
If we denote the required velocity by v (¢), then this means: 
| As/At — v (£) | can be as small as we please provided At is sufficiently 
small. This statement can be rephrased in terms of the theory of 
limits and it is : v (t) is the limit of the relation (1) for At > 0: 


$0 aS a Q) 


At~0A! pni-+0 At A 





Hence instantaneous velocity of a moving body is the limit to which the 
ratio of the covered path to the elapsed time tends when the latter tends to zero. 
We have thus defined the concept of instantaneous velocity and 
found a method for its evaluation, 7.e. we have solved both questions 
of our initial problem. 


Note |. In formula (1) we should consider ¢ (the instant for 
which we want to establish instantaneous velocity) as a constant; the 
process which forms the basis of limit transitions implies that the 
time interval A? tends to decrease indefinitely while the initial instant 
of this time interval remains constant. It is evident that the instant 
écan be chosen arbitrarily but once it is chosen it should remain 
constant during the process of calculating the velocity. 


Note 2. The limit of the relation (2) may or may not exist 
depending on the choice of the instant ¢ and on the form of the 
function f (¢). If it does not exist, then at the corresponding instant 
the velocity of the moving body cannot be detcrmined by the method 
given above. In such cases it is not advisable to seek another defi- 
nition for the concept of instantaneous velocity but assume simply 
that at such an instant no instantaneous velocity exists, 

e 
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Example 1 (uniformly accelerated motion—falling of bodies in 
vacuum due to gravity). s = f(t) = gt?/2, where g is a constant 
(the so-called gravitation constant) : 


As=f(i+ At)—f()) ane Saga slal’, 
As_flitai—fl)_ 9, gat. 
Bi aR ee Oe 
As 
i) = lim —=gt 
v(t) Re 


Hence the velocity of a freely falling body in vacuum increases 
in proportion to the elapsed time. 


Example 2 (simple harmonic vibrations). s = f(t) = asin of 
(where a and © are positive constants). 


Here s denotes the distance of the moving body from an initial 
position which is considered to be positive in one direction (for 
example, to the right) and negative in the other direction (to the 
left). 


As=f(it Af) —f() = asinw (t+ Af) — asin of= 





NY. woAt 

=2a4 COs ©) (« +5) sin = 
. OAL 
sin 7 
AS =avcoo(te aoe = 3 
At 6 2/ wat? 

2 
v(t) = awcos ot. 


In this example the velocity of the moving body (if we assume 
that it moves along a straight line) evidently varies continuously 
between s = a and s = —a (oscillations with constant amplitude). In 
accordance with our agreement as to the sign ofs we evidently have 
a positive velocity when the body moves to the right and a negative 
velocity when it moves in the opposite direction. At the points 
5 = -+ awe should have sin » ¢ = + 1 and therefore cos w ¢ = 0; 
hence at these points the instantaneous velocity becomes zero; this 
can readily be understood, for at these points changes in the direction 
of motion occur and therefore the sign of the velocity also changes. 
The maximum velocity | v (é) | = @ © is attained when cosw ¢= + 1; 
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at that instant += asin wt = 0, te. the body passes through the 
initial position. 


§ 27. Local density of a heterogeneous rod 


A rod is a physical body whose form approaches a section of a 
straight line; its cross-section is smal] and constant along its whole 
length. A rod is said to be homogeneous if any two cuts of the same 
length have the same mass (or, what is the same, the same weight) ; 
in a homogeneous rod the masses of any two sections are proportional 
to their lengths, so that the ratio d of the mass of an arbitrary section 
to its length is constant and is the same for all sections. The quantity 
d can be regarded as the mass per unit length of the rod; it is usually 
known as density of a homogeneous rod. 


If the rod is heterogeneous, 7.e. its mass is denser at some 
places than at other places, then, generally speaking, different masses 
correspond to two sections of the same length. The ratio of the mass 
of a section to its length will be different for different sections; it is 
therefore natural to call this ratio average density of the given section 
of the rod. Since in a given section the density of mass can change 
considerably many times, therefore, generally speaking, the average 
density of this section does not tell us anything about the particular 
density of the mass in the immediate neighbourhood of any point on 
that section in the same way as in the previous paragraph the 
average velocity of a car during one hour made it impossible to draw 
conclusions as to the velocity of the car at the given instant. 


Thus if we want to determine density of the substance in the 
immediate neighbourhood of a particular point on the rod, we en- 
counter difficulties of the same kind as those in § 26 when we were 
trying to assess instantaneous velocity of a moving body. And since 
these new difficulties are in all respects similar to the old difficulties, 
therefore we are quite justified in assuming that we shall be able to 
solve them by the same methods. 


Lct us take one end of the rod as the origin 0 and denote the 
abscissa of any point on the rod with respect to this origin by x. The 
mass of substance along the section (0, *) is a function of x which 
increases as x increases; let us denote it by m = f(x). The sectionof 
the rod between x and Ax (where Ax is an arbitrary positive number) 
evidently contains the mass 


Am = f(x + Ax) — f(s); 
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and average density of substance along that section is evidently , 
equal to 





Am _ f(x + Ax) — fla) 
Ax AX 


If the number Ax is large, then density can considerably vary along 
the section (x, x + Ax) and we therefore have no reason to assume 
that the average density will be indicative of the density of the sub- 
stance in the immediate neighbourhood of the point x on the rod. 
On the other hand, if Ax is very small, we can assume that density 
of the substance will not change considerably over the length Ax so 
that the average density of substance along the section of length Ax 
will be close to the required density of the substance in the immedi- 
ate neighbourhood of the point x. ‘The smaller the number Ax is, 
the more convincing is this argument; as in the previous paragraph, 
we therefore conclude that we can take the following quantity as a 
measure of density of substance in the immediate neighbourhood of 
the point x on the rod : 


f(x + Ax) — f(x) 


F Am ‘ 
d(x) = lm = lim ; 
7 Ax720 4* ax 30 Ax 


(assuming, of course, that the above limit exists). The quantity d (x) 
so determined is usually known as the local (t.e. at the given spot) 
density of the rod at the point x *), We can obviously regard this local 
density as a measure of the velocity with which the mass of the rod 
changes with an increase in length; this point of view connects the 
problem in this paragraph even more closely with the problem solved 
in § 26; the remaining difference is, first of all, due to the fact that 
the factor of time is completely absent in our present problem; if 
there we were seeking the instantaneous. rate of change over the 
distance covered in the course of time, we are now trying to establish 
the local rate of change of the mass of the rod as its length increases. 
Time has no place in this process. It is thus possible to speak of the 
rate of change of a function in relation to the independent variable 
irrespective of the real meaning of these two quantities. This 
generalisation of the concept of velocity is of utmost importance in 
mathematical theory; we shall analyse it in detail in the next para- 


graph. 





*) The term “local” (at the given spot) is already found in earlier chapters ; it 
js a property which can vary at different points, 
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§ 28. Definition of a derivative 


Let» =/ (x) be an arbitrary function of the independent vari- 
able x. Ify changes uniformly as x changes (as wc know, the neces- 
sary condition for this to be so is that f(x) should be a linear 
function : f(x) = xx + @), then the rate of change of y with respect 
to x is equal to a constant number « which in its turn is equal to the 
ratio of the increment of y to the corresponding increment of x 
(« = A»y/ Ax) and this ratio will always be the same irrespective of 
the initial value of x and its increment Ax. We have seen all this 
in § 25 where we said that in the general case, when » changes non- 
uniformly, the problem of changes of y with respect to x cannot be so 
easily solved. If we pass from a value x of thc independent variable 
to itsnew value x+ Ax, then y receives the increment y= f(x+ Ax) 
—f (x); the ratio A.y/ Ax will differ for different sections, i.e. it will 
generally depend on the initial value of x and the increment Ax of 
the independcnt variable. This ratio describes the average velocity of 
change of » with respect to x along the section (*,x + Ax). If we 
wish to find the local velocity of this change, i.e. the rate of change 
of y with respect to x in the neighbourhood of the given value x of 
the independent variable, then, by repeating word by word the argu- 
ments used in the two examples considered above, we evidently con- 
clude that this velocity should be defined as the limit 
Ay fix + Ax) — fo) 


lim = lim “= (1) 

Ax>04* nx 30 Ax 
of the ratio of increment of the function to the increment of thc 
independent variable when the latter tends to zero. All remarks 
made in connection with the two examples considered above rcmain 
valid in the general case. Wecan only speak of local velocity when 
the above limit exists; otherwise there is no velocity. The local 
velocity is in general different at different points (i.e. for different 
values of the independent variable x); in the expression (1) we must 
regard the valucs of x as constant during the limiting process (in 
this case only Av changes) ; however, although this constant value 
can be chosen arbitrarily, the resulting velocity will be different for 
every choice (therefore we say that it is “‘local’’). 


The local velocity as determined by the limiting process (1) can 
either be positive or negative or zero. It is quite easy to establish 
the true sign of velocity. In fact, if, for example, the limit of the 
ratio A y/ Ax for x > 0 is positive, then, as we know (theorem 2 
§ 10), this ratio is also positive provided Aw is sufficiently small; 
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this means that we should have Ay > Ofor Ax > Oand Ay <0 
for Ax <0; in other words, increments of the function and the 
independent variable have the same sign in all cases. This means, 
in its turn, that y increases as x increases (and consequently y 
decreases together with x). If on the other hand velocity is negative, 
then an analogous argument shows that y should decrease as x 
increases and vice versa. Hence the sign of the rate of change 
determines the direction of change of the function (?.e. it slows 
whether the function increases or decreases); the rate of change is in 
each case determined by the absolute value of this quantity. 


Finally we note that in all our examples we have confined 
ourselves to cases where the increment Ax is positive (although in 
some examples at the end of § 26 all calculations remain valid and 
lead to the same results, as can readily be shown, for negative A+). 
But in expressions of the type (1) we shall always understand the 
limiting process in the ordinary sense, 7.e. we shall require that the 
limit should exist for both Ax — + 0Oand Ax— — 0 and that 
these two limits should coincide; only when these conditions are 
satisfied, we shall regard the local rate of change of the function y 
with respect to x as existing. 


We can thus see that from a purely mathematical point of view 
the calculation of the rate of change of a function always leads to a 
definite limiting process. When we are given the function y = f(x) 
and when we choose the value x of the independent variable, it is 
necessary in’every case to evaluate the limit 


fem fet Aa) — (0). 
Ax20 Ax 





In cases when this limit exists, it has in general different values for 
x3 it is therefore a function of « which is usually denoted by y’ or 
Sf’ (x) and is know as the derivative of the function y = f(x) with 
respect to the independent variable x. Thus 


ee ae ae iene ga AC 
Ax—>0 Ax 
The derivative of the funclion y = f(x) with respect to the independent 


variable x is the limit of the ratio of increment of the function to the increment 
of the independent variable, provided the latter tends to zero. 


The operations of finding the derivative f(x) of the given 
function f(x) is known as differentiation of the function. In order to 
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evaluate rate of changes which take place in nature and in technical 
processes, we must learn to differentiate as many classes of functions 
as possible. 


Differentiation of functions is one of the most important 
operations of mathematical analysis and we must therefore study it in 
great detail. The science dealing with the laws of differentiation 
and properties of derivatives is known as differential calculus, and is one 
of the main branches of mathematical analysis. At first we must 
learn a series of general rules and special methods of differentiation 
which will ultimately enable us to find derivatives of a very wide 
class of functions which also includes all elementary functions. We 
shall do this in the next paragraph. 


§ 29. Laws of differentiation 


In this paragraph we shall study the general methods of 
differentiation and evaluate derivatives of certain functions. We shall 
thus gradually learn how to find derivatives of a very wide class of 
functions. 


1. Derivative of a constant. Derivative of a constant is equal to 
zero. 


In more accurate terms this means that if the function y = f(x) 
is constant along a certain section which contains the point x, then 
y’ = f' (x) =0. In fact, provided Ax is sufficiently small, we have 
S(* + Ax) = f(x) and therefore Ay = 0; hence Ay/ Ax = 0 for 
Ax # Oand therefore »’ = lim oy 0. 

Ax20 Ax 


2. Derivative of a power. Jf y = x” (where n is a positive 
integer), then y’ = nx™-1, 


In fact, Newton’s binomial formula gives us : 


Aya (eb Ax) xmas tart > Dent (any? 
Pvewt (Ax), 
and therefore for Ax 40 
BD gest gh) sya a 
Ax yo EE ARH ee (Ax) Pw 
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All terms from the second term onwards on the right hand side 


of this equation contain the factors Ax and therefore tend to zero 
for Ax +0. Hence in the limit 


3. Derivative of asum. Jf 
ypoutuet..ty,, 


where Uy, Us, ... 5 Un are functions of x which have a derivative at the point x, 
we have 


Py Sey bt wtet weet wes 


or in short: derivative of an algebraic sum is equal to the algebraic sum 
of the derivatives. In fact, let us assume that x receives an increment 
Ax, thefunctions u1, Ue, ..., Un, y receive corresponding increments 
Aly, Aly,..., AUn, Ay. It follows from (1) that for the new 
value x + Ax of the independent variable we have the following 
expression : 


wa +Ay ao (uy +AU) ote (ty + Atle) a a) at (ty, + A inde (2) 
Substracting (1) from (2) we have 


Ay=Atl, Aug tb... HAM, 
and therefore for Ax ~ 0 


Ay _ Ati, Ala Aun, 
Ax Ape ae oe Ax ? 
and, finally, taking the limit for Ax — 0 we find that y’ exists and 
that 


OF Eg ea en a 


4. A constant factor can be taken outside the symbol of differen- 
tiation. More accurately: ify = au, where ais a constant and u a func- 
tion of x,and if u has a derivative at a certain point, then y’ exists at that point 
and y’ =au', In fact, let us assume that when x receives an increment 
Ax, uw and y» receive corresponding increments Au and Ay. We thus 


have 


yteaAy=alu+ An); 
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subtracting the equation y = au term-by-term from this we find: 


Ay =4 At, 
and therefore for Ax 4 0 
Ay _ Au 
Ax Ax ; 


Finally taking the limit for Ax — 0 we find that »’ exists and is equal 
toy’ = au’. 


5. Derivative of a polynomal. The four laws which we have so 
far established lead us to a very important result: they show that 
every polynomial y = ag x" + a, x%1+ ...-+a, has a derivative 
for every value of x and it enables us to write the expression for this 
derivative. In fact, applying the rules established above we can 
readily see that 


a SS fee eid age ae aa, 
Hence derivative of a polynomial is always a polynomial with one degree 
less than the degree of the given polynomial. 


6. Derivative of aproduct. Let » = wv, where u and v are func- 
tions of « which have derivatives at the point x. Using the usual sym- 
bols we have: 


Jt Ay = (u + Au)(o + Ad), 
and on subtracting we obtain 
Ay=t Av+tv Aut At Ad, 
and therefore for Ax 5 0 


Bt ge A 


Ax Ax” Ax Ax 


When Ax -—- 0, we should consider wu and v to be constant on the 
right hand side (they depend on x but not on Ax) while Au and 
Av tend to zero (this follows from theorem 8 §11, since the ratios 
AufAxand Av/Ax have limits in accordance with our assumption). 
Therefore the limit of the last term on the right hand side is equal to 
0.v' = 0 and limiting process gives : 


yos= uv’ + ou’: 
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derivative of a product of two functions is equal to product of the first factor 
and the derivative of the second plus product of the second factor and the deri- 
vative of the first. ’ 


Note. Existence of the derivative »’ is at first not assumed but 
proved in the course of the argument in the same way as was done in 
deducing laws 3 and 4. The full statement of this rule should there- 
fore be as follows : if the functions uand v have derivatives at certain points, 
then the function y == uv also has a derivative at that point, and y'=uv' +-uu'. 
This note applies equally to all subsequent laws of this type. 


By using simple induction the reader will be able to extend the 
above law to include any number of factors. 


If y == Uy Ug...Un, then (provided the derivatives of the functions 
U1, Ug, vey Uy CXISt) 


DP” Se aly te Ce GW get PoE hg a 
in order to write down derivative of a product containing any desired number of 
factors we must differentiate one factor and multiply the derivative so obtained 
by the product of all remaining factors; we nwst repeat this process in all 
possible ways and add all the products so obtained. 
: : 


We leave to the reader as an exercise to prove that the laws 2 
and 4 can be obtained from the above law and that they are, in fact, 
particular cases of this kind; the extension of old results on a new 
basis is always instructive and can often be used as a useful check 
for the results obtained. 


7. Derivative of a quotient. Let y = w/v, where u and v are 
functions of x which have derivatives at the point x, and Iet v 4 Oat 
at this point. Using the usual symbols we find: 
u+ Au 


I BPS Ay? 


and by subtracting we obtain : 


Hence for Ax + 0 
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here, as in the above deduction, uw and v are constant for Ax — 0 
and Av — 0; therefore the limiting process proves the existence of » 
and gives us the following expression for the derivative 


: vu’ — wv (3) 


In particular, when the functions u and v are polynomials, the 
ratio w/v represents a rational fraction; formula (3) thus shows that 
derivative of a rational fraction is always a rational fraction. 


8. Derivatives of trigonometrical functions. (a) Let y = sin x; 
then 


y+ Ay =sin (x + Ax), 








Ay = sin (x + Ax) — sins = 200s («+ 4*) sin $', 
ne ane 
1 —_—_ —— 
Ad _ ( Ax) 2 _ ( 4*) 2. 
Ay 2 098 + =) An x + 5 Aa 
ae 


the last factor tends to unity as its limit for Ax-> 0; on the other 
hand it follows from continuity of the function cos x (cf. § 24) that 


cos ( « +4*) + cos x (Ax — 0), 


therefore the limiting process proves the existence of the limit 
lim (A2) = y’ and gives: 
Ax70 \Ax ? s 


yy = cos x. 


(b) Let_y = cos x; a similar argument, which we leave to the 
reader, gives 


, 


yo = — sin x. 


(c) Let y = tan x = sin x/cos*; we are dealing here with 
the ratio of two functions whose derivatives are already found ; 
assuming that sin x = u, cos x == v, we find, according to formula (3) : 


»_ COS « COs X -— sin x (— sin x) | 
cos* x cos* x ~ 


(d) Ify = cot x = cos x/sin x, then a similar calculation gives 


; 1 


PO sin? x 
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The reader will have no difficulty in finding derivatives of the 
functions y = sec x = I/cos x and _y = cosec x ='1/sin x. 


9. Before going further we must introduce another very im- 
portant limit relationship. In § 17 we have shown that the expres- 
sion (1 + 1/n)" tends to a definite limit when n runs successively 
through the series of natural numbers, and we denoted this limit by e; 
let us now assume that in the expression (1 -+ 1/x)* the variable x 
increases indefinitely (v > + 00) andruns through allintermediate values ; 
we can see that we have in this case: 


lim(14+-—-)' =e. (4) 


In fact, let us denote by n the greatest integer for a given value of x 
which does not exceed x so that 


nawecn+l. 


Therefore we evidently have for x > | | 
(tga) Org) ee)" 


or 





if x > + oo, then evidently n > -++ w; on the left-hand side of the 
above inequalities the numerator tends to the limit ¢ and the denomi- 
nator tends to unity, while on the right-hand side the first factor tends 
to e and the second factor tends to unity. Thus the left and right- 
hand sides tend to the same limit e for x ~ + oo; hence the main 
parts of the inequalities also tend to the same limit, which proves the 


relation (4). 
Let us now assume that «> — o and y = — x, so that 


y—> + wand 
(ag Gan) ee) 


=(4 54 ,)"@+h)s 
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the first term on the right-hand side tends to the limit e for_» > + © 
in accordance with the proved proposition (since » — 1—~ + ©) 
and the second term evidently tends to unity ; this shows that 


(1+ tye @+- 0), 


ie, that the relation (4) applies every time for] +| —» + oo irrespective 
of the sign of x. 


Let us now assume that in the expression 


1a 
(1a) 


a tends to zero in an arbitrary way (we are only assuming that «40, 
since the above expression becomes void); assuming that 1 /« = x we 
have : 


Fr So 1 x 
ed Ce cer) 
we have | «|—> + oo for « + 0 and therefore in accordance with the 


above proof (1 + 1/x)*— e; the above equation therefore shows 
that 


1 


lim (1 +a) * =e (5) 


a—>d 


We have thus proved the above relation and we can therefore use it 
in future. 


10. Derivative of a logarithm. Let_y = log,+, where a4] isa 
constant positive number and x >0. In_ this case 


Jt Ay = log, (x + Ax), 


Ay = log, (x + Ax) — loggx = log, (1+ + **) : 


x 
Ay) Ant Ar) Lig, { a 
ar aa ear ete = ea) 
Let us now assume that Ax /« = «; hence we have « — Q for 
Ax — 0 and it therefore follows from the relation (5) that 


x 


(1A) pales 
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and since the function log g x is a continuous function, 


x 


Ax 
logs (1 + 42 } log a« (Ax — 0); 


x 


hence lim (42 =’ exists and 


Ax—+>0 Ax ‘ 


pean e 
a Sa & 


This result is remarkable insofar as the derivative of a trans- 
cendental function log g x is a simple rational function of the forme / «x, 
where ¢ is a constant. The form of this derivative will be particularly 
simple if we choose ¢ as the base of the logarithmic system, for in that 
case log. ¢é = log, e = 1 and 


We shall later see that many other analytical formulae are obtained 
in a particularly simple form when ¢ is taken as the logarithmic base. 
For this reason ¢ is usually taken as the logarithmic base in analysis; 
logarithms with the base ¢ are known as “natural’’; the natural 
logarithm of x is denoted by the symbol In x: thus ify = In x, then 
y’ = 1/x; if, on the other hand _y = log, x, then, as we have seen, 


f 


elie, 
J —~ x Of8a és 


but when taking the logarithm with the base a of a = "4 we 
obtain : 


logga=1=Inalogae, logae= ;—, 


so that we can write down the above equation in the form 


11. Derivative of a composite function. Let y» be a composite 
function of x z.e..y is given as a function of an intermediate function 
u, y = f (u), and was a function of x, wu = © (x); so that 


y=FT9 (x) ]; (6) 
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we must find derivative of the function (6) (i.e. differentiate y with 
respect to x) while knowing the derivatives of the functions f (wu) and 
© (x) (i.e. when we are able to differentiate y with respect to u and u 
with respect to x). 


Let us assume that x receives the increment Ax; in that case u 
receives a corresponding increment Aw and therefore » receives the 
increment Ay; if Ax — 0, then Au > 0, Ay — 0, assuming that 


AY py, if 
pn EZ SW, if AU £0, 


0, if Au = 0. 


Owing to the fact that we have Ay/ Au > f’ (u) for Au > 0, 
therefore evidently. « -> 0 for Ax — 0; further, for Au-4 0 it follows 
from the definition of « that : 


Ay=/f' (u) Auta Au 


but it is clear that this relation is also valid for Au = 0, and therefore 
it is always valid; dividing both sides of this relation by Ax we have: 


Au, 


AD _ pr (yy AY 
Ax DMN ee ae 


but we have Au/ Ax — 9’ (x) and « > 0 for Ax > 0; therefore the 


limiting process proves the existence of the limit lim (42) = y’and 
Ax->0 \A* 
gives 


y' =f" (u) e' (x) =f" [9 (x)] 9" (*). (7) 


We can therefore see that derivative of a composite function is equal 
to product of the derivative of the given function with respect to the intermediate 
variable and the derivative of the intermediote variable with respect to the 
independent variable. Hence in order to find derivative of a composite 
function which is given in the form of a two-link chain y = f (u) and 
“u = 9 (x). we must simply differentiate each link of the chain sepa- 
rately and multiply the derivatives so obtained. 


Example 1. y = sin kX, where k is a constant; let us assume 
that kx = u so that 


y= sinu, u= kx; 
it follows from formula (7) that 


y’ =cosu.k = k cos kx. 
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Example 2. »y = In cos x, cos x = 2,» = In u; according to 
formula (7) we have 
, sin x 


: ( — sin x ) t 
= —(-—sinx) = — = — tanx. 
J u COS x 





By using simple induction we can extend the above law for 
differentiation of composite function to include functions given in 
the form of a chain of three or more links : 
thus, if 

y=f(u, w=), v= v(x), 
then derivative of y with respect to x can be found by the formula 
Y=HLMr OY @+t/ Cele MB ee’ l¢ Gly’ @). 

12. Derivative of an inverse function. We know that the relation 
which defines y as a function of x enables us in certain cases to define 
the inverse function, i.e. x as a function of y. Let» = f(x) and let 
the inverse function be x = 9(y). Let us assume that the nonzero 
derivative f’ (x) exists at a point x = 9(y); the increment Ay of y 


corresponds to the increment A x of x; since Ay = f(x + Ax) — 
f(x), therefore we must have Ax 4 Ofor Ay # 0; thus for Ay 40 


aren (8) 
ay” AD 
Ax 


Let us now assume that Ay — 0; if the function x = 9(y) is conti- 
nuous at the point y, wc have Ax — 0 and therefore 


Ay 
Ax 
the relation (8) thus shows that the ratio Ax/A y tends to 1/f’ (x) for 


Ay — 0; in other words, the derivative 9’ (y) exists and is equal to 
1/f' (x). We thus arrive at the following law for differentiating an 


> f" (x)%05 


inverse function : 


Uf the function y = f (x) has a nonzero derivative at the point x and the 
inverse function x = 9(y) ts continuous at the pointy, then o'(y) exists and 
is equal to 1[f'(x). 


13. Derivatives of exponential functions. Let y = a*, where a is 
a constant positive number; in that case x = logy y; according to 10 
the derivative of x with respect to_y is equal to 


y 1 


= 


~ ylna 


2 
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and it follows from the above law for differentiating inverse functions 
that 


’ 


pairs a = yIna =a" lng; 


in particular, if y= e*, then »’ =e, i.e. the “simple” exponential funclion 
is invariant in differentiation : derivative of this function is equal to the 
function itself. 


If y = e**, where «% is a constant, then we can regard y as a 
composite function of x by assuming that ax = u; it readily follows 
from (7) that 


y= 06 = HY 
In practice: one often comes across the so-called ‘‘hyperbolic 
functions”’, e.g. the “hyperbolic cosine’’ 





cosh «+ =! oe 
oie) ee 
and the “hyperbolic sine” 
4 Mic 
. e*—e-? 
‘sinh x = aaa a 


A 
the readcr will be able to show by himself that cach of these two 
functions is the derivative of the other. 


14. Derivative of a power function. Let _» = x*; where « is an 
arbitrary constant. We have seen in 2 that if « is a natural number, 
then 


= axt; 
we will now show that this formula remains valid for every «. 
We can write 
y ost xh = ot In. 
and assuming that « In x = u, wehave 
“y= eh, u=alnx, 


and according to the law for differentiating composite functions 


le z 
w = gu, = x ae axeenl, 
: a” x 
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which we wanted to prove. 
In a particular case when « = 4 we have : 
ee 
27x" 


When « = —1, y = I/x, y’ = — 1/x*, and so on. 





p=Vx, 7 


This method can be used for finding derivatives of a much 
wider class of functions , 


y= {f(x} P™, 
where f(x) and 9(x) are differentiable functions. In fact, 


y =e Pln fie) = gt 4 = © (x) In f(x), 


and therefore in accordance with the law for differentiating composite 
functions 


yf =e {9 (a) Inf’ = (£62 (9 (TE. +0! (In SON} 


Example. y = x, y’ = x*{} + In 4}. 
15. Derivatives of inverse trigonometrical functions. 


(a) Let» = arcsin x for — 1 < x <1 so that y increases from 
— w/2 to + w/2 as x changes along the section (— 1, + 4). Since in 
this case x = sin y, therefore, as a result of the law established in 11, 


, 11 1 ae 


FO Cosy Vil—sin?y | Jl — x? 











where the positive square root should be taken so that cos y» > 0 for 
—72/2<y»< +7/2,. Hence for » = arcsin « we have 





Sep seek: seal): 


We can similarly prove that 


(5) if » = arccos x, then 


1 
‘See (- 1X x < )); 
D Gi = ( 
(c} if y = arctan x, then 
1 
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(d) if » = arccot x, then 


yep (—o<*< +o). 

Note 1. It is interesting to note that inverse trigonometrical 
functions which are transcendental have very simple derivatives 
expressed in terms of very simple algebraic functions (in the case of 
arccot x and arctan x these functions are even rational) (we have an 
analgous case in differentiating logarithms). 


Note 2. It is also interesting to note that-the derivatives of 
arcsin x and arccos x differ from one another only in sign (the same 
also applies to the derivatives of arctan x and arccot x); this can 
easily be foreseen if the following wellknown trigonometrical identities 
are differentiated : 

arcsin x + arccos « = > arctan + + arccot «= > 

16. In this chapter we have learnt to differentiate all simple 
elementary functions ; derivatives of these functions are listcd in the 
table below : 



































y J J J b) » Jy y! 
| 
a 0 a= ‘a*\|na}tanx . arctan x - 7 
| cos* x l+x? 
I ‘ 
xe J axel] Inn | a cotx | — eels arccotx Spee: 
x sin? x 1+.2° 
1 1 J ; ] : 
— | — —; |logax arcsin «| ——=====~} sinh x | cosh x 
x x x Ina V1—x? 
= ae é , 1 h ‘oh 
——. ] sin x | cos x J|arccosx!— —=--=-=! cosh x | sinh x 
x % 
v 2V x Wel Sw 
\ ¢ e* cos x | —sin x j 





The laws of differentiation which we have established above 
enable us to find without difficulty derivatives of any combination of 
functions obtained as a result of algebraic operations or by construc- 
ting any number of composite functions. In order to make the 
reader appreciate how wide this class of functions really is, which he 
is now able to differentiate, we recommend him to try, as an exercise, 
to find a function for which he cannot find a derivative. The 
difficulty of this problem will convince him that his ability to 
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differentiate is very wide indeed. However, the knowledgc of princi- 
ples is insufficient; every mathematician should learn to differentiate 
quickly and unmistakably and in order to learn this he must do 
many exercises. 


Many exercises for differentiation are given in the problem book 
by B.P. Demidovich, Section II, § 1. In addition to these exercises 
(problems 14-68) we would also recommend thc student to think over 
some other problems (for example, problems 72, 73, 79, 90, 21). 


§ 30. Existence of functions and their geometrical illustrations 


The given function » = f(x) has a derivative at the point x if 
and only if the following linit exists : 





Ax—>0 Ax Ax30 A* 


It can readily be seen that it is necessary for this limit to exist that 
the function f(x) should be continuous at the point x; in fact, ,it 
follows from theorem 8 § 11 that the ratio A y/ Ax will have a limit 
for Ax > 0 provided the increment A » isinfinitely small for ax— 0, 
and this means that the function f(x) is continuous at the point x. 
Hence the function /(x) cannot have a derivative at a point of dis- 
continuity ; in particular, a function which is everywhere discontinuous 
cannot have a derivative (let us remind the function D(x) §§ 4, 20). 


Can a continuous function have no derivative ? It can readily 
be shown that this is possible. In fact, it may happen (and it fre- 
quently does happen) that the limits 


lm —-, lim “~~~ (1) 


exist but do not coincide ; a single limit for Ax -> 0 does not exist in 

this case and therefore a derivative does not exist either. This is the 

case, for example, with the function y = |x| for x = 0: since at this 

point y = 0, so Ay coincides with y (and Ax coincides with x); we 

therefore have: 

BP Pie Wily 
Xx 


Ax x 


this ratio is equal to unity for every + > 0 and it is equal to —1 for 
every x < 0; therefore 
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The question also arises whether it may happen that the 
function y = /(x), which is continuous at the point x, tends to neither 
of the limits (1) so that there is no left or right derivative ? This 
case is also possible but here the construction of an example is some- 
what more difficult. Let us consider the following function which is 
defined for all values of x : 


p= f= 
0 (ie ) 
We have for x 4 0 
= ul 
| f(x) | = | x sin =| ai 


therefore f(x) —-0 for x > 0 and since f(0) = 0, the function f(x) 
is continuous for x = 0. As in the preceding example we have here 
Ax =x, Ay = 9; therefore for Ax 4 0 


BD. I a ei Ne, axa, 2 W 
he ge = Ax 


if n is an arbitrary natural number, then for 


) 
Ae age yes (2) 
we have 
1 w 
AC r 
and for i 
eae ee 
* = (dn — lyn (3) 
1 Ta. 
roses 2nn— =, sin Rees 


But Ax will pass an infinite number of times through values of the 
form (2) and (3) as n increases indefinitely for Ax > + 0; 


AY aces A 

— = sin—— 

Ax Ax 
varies an infinite number of times between + 1 and — 1 and cannot 
tend to a limit. This means that the first of the limits (1) does not 
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exist in this case ; absence of the second limit is proved in exactly the 
same way. 


In all cases considered so far the given function had no deriva- 
tive at one point only (for one value of x) but derivatives exist at all 
other points. On the basis of the above examples it is quite easy to 
construct a continuous function with two, three or an arbitrary 
number of points where no derivative exists. However, it was 
believed for a long time that a continuous function should neverthe- 
less have derivatives everywhere except at certain isolated points; 
this was confirmed in the first place by the geometrical picture which 
we shall now study; only in the second half of the last century an 
example of a continuous function was published which had no 
derivatives at all. At present many methods for constructing such 
functions are known; they are, however, all too complicated to be 
given here. 


The geometrical representation of a function is, as we know, a 
very valuable method of investigation, because many characteristics 
of the function and its behaviour would be difficult to elucidate from 
its formula (or from a table), while the graph illustrates them quite 
clearly. Every characteristic of a function should appear as a geo- 
metrical property on the representative curve in its graphical repre- 
sentation. It may be forseeen that the graph which represents the 
function can also give us a visual representation of its derivative. 
This geometrical analysis of the derivative is very important in 
analysis as well as in geometry and we shall now proceed with its 
study 


Let us assume that the graph represents the function _y = f(x) 
on the system of cartesian coordinates (x, y) (Fig. 12). Mark the points 
M(x, y) and N(x + A x,y + Ay) on 
the curve. Draw theline MP parallel to 
the OX axis. It is evident that in the 
right-angled triangle MNP the sidcs 
adjacent to the right-angle are A4P= Ax 
and NP = ay. Therefore the ratio 
Ay/ Ax is equal to the tangent of the 
angle formed by the chord MN and the 
positive direction of the OX-axis. 


Let us now assume that Ax tend 
to zero. In this case the point M ° 
remains stationary while the point WV 
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approaches it indefinitely closely. The chord MN will change its 
direction and at every moment of this process the gradient of the 
chord will be : 


A? 


se a ae 


) 
if the given function has a derivative at the point x, 7.2. if the follow- 
ing limit exists : 


. Ay ’ ' 

it ey) 
Ax70 AY 

then this means geometrically that the direction of the chord MN 

tends in this process to a limiting position MT which makes an 

angle « with the positive direction of the OX-axis, where 


fan e Stan lien, 22 ey (4) 


Ax->0 Ax>0 AX* 


The straight line MT can be defined purely geometrically as the 
limit in a position of the chord MN which joins the point M with the 
indefinitely approaching point V on the same curve and is known as 
the tangent to the given curve at the point M. Equation (4) shows 
that the derivative of the function f (x) at the point x is equal to the gradient 
of the tangent to the corresponding curve at a point with the abscissa x. If we 
assume as usual (in accordance with our visual representation) that 
the direction of the tangent is characteristic of the direction 
of the curve itself at the given point, we can directly see that 
if the curve (as x increases, t.e. from left to right) rises, then its 
derivative is not negative and the steeper the gradient, the greater 
the derivative; on the other hand, if the curve goes downwards (from 
left to right}, the derivative is not positive and in this case the abso- 
lute value of the derivative is the greater, the steeper the gradient is. 
This geometrical representation is in full agreement with the definition 
given at the beginning of this chapter where a derivative is defined 
as the rate of change of _» with respect to x; the quicker y increases as 
x increases, the steeper the gradient of the curve y = f(x) and the 
greater therefore the rate y’ of this increment.: 


The above geometrical method of representation of a derivative 
enables us to understand more clearly the cases where no derivatives 
exist which we have considered at the beginning of this paragraph. 
Fig. 13 represents the graph of the function y = | x| and Fig. 14 the 
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function y =x sin (I/x). In the first case the line» =|x| has a 
definite direction to the left and to the right for x = 0, but these 





Fig. 14. 


directions are not the same; in the second case the curve y = x sin(I/x) 

has no definite direction to the left or to the right for x = 0 

(there is no tangent); as | x | gets smaller and smaller, the direction of 

the tangent varies repeatedly between the straight lines y = x and 
= —vx and therefore cannot tend to a limiting direction. 


Finally from the point of view of the geometrical interpretation 
it is easy to understand why it was thought for so long that every 
continuous function should have a derivative (with the exception of 
some singularities) : in fact, it is very difficult to imagine a continuous 
curve which would not have a tangent ata single point; and even 
now when existence of such curves has been established beyond doubt 
we can imagine such a curve only very approximately; the position of 
such a curve with respect to its every point is approximately the 
same as the position of the curve represented in Fig. 14 in the neigh- 
bourhood of the point O. However, such curves exist and their 
discovery was one of the most vivid examples in the history of mathe- 
matics that intuition, which reigned for centuries, may sometimes be 


mistaken. 


Finally, let us note that knowledge of the value of the derivative 
y’ makes it possible to use elementary methods for construction of the 
tangent to the curve y = f(x) at the point M. In elementary 
geomtery we have learnt how to construct a tangent to a circle and 
in analytical geometry how to construct tangents to all curves of the 
second order; but only differential calculus shows us how to construct, 
in general, a tangent to an arbitrary curve at a given point. 


CHAPTER VII 
DIFFERENTIALS 


§ 31. Definition and relationship with derivatives. 


If the function y = f (x) has a derivative at the point x, 


then the quantity 


is an infinitesimal for Ax > 0. It therefore follows that 
Ay—y' Ax = Ax 

is an infinitesimal of a higher order as compared to Ax; using the 
symbols introduced in § 12 we can denote this quantity by o( Ax); 
hence 

Ay =y' Ax +0 (Ax). (1) 
Owing to the fact that »y’ = f’(x) depends only on x and remains 
constant for Ax — 0, therefore, y’ Ax isproportional to Ax; hence 
the relation (1) shows that the increment of a function which has a derivative 
at the point x can be represented as sum of a quantity proportional to Ax and 
an infinitesimal of a higher order as compared to Ax. 

Conversely : if the increment of the function y =f (x) at the point x 

can be represented in the form 

Ay =a Ax +0(Ax), (2) 


where ais independent of AX, then the function y is differentiable at the point 
x and f(x) =a. In fact, it follows from (2) that 


oz =a tol); 
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and therefore 


= > a (Ax -> 0), 


heey! = 
Example 1. f(x) = In x; it follows from formula (1) that (1 +.) 
Sl) =f" (1) 9 + oy) (9 + 0); but f(1) = 0, /’(1) = 1 and we 
have 
n(l+ 9) = 9 + o(y), 
or, which is the same, 
n(1l + y)~y (y +0); 


only natural logarithms possess this most important property which 
makes their use so convenient in mathematical analysis. 


Example 2. f (x) = ¢*; it follows from formula (1) that f(x) 
—f (0) =f" (0) x + o(x) (x > 0); but f(0) =‘f' (0) = 1 and therefore 


e* — 1 =x + 0(x), 


or, which is the same, 


ewe —1lr~x (x>0). 


The expression for Ay givenin formula (1) is exceptionally 
important, for it shows that the increment of the function given 
accurately up to infinitesimals of higher orders can be represented by 
a linear function of the increment of the independent variable. In 
this formula the first term _y’ Ax which is proportional to Ax is said 
to be differential of the function » and is denoted by dy so that 


Ay = dy +0(Ax). (3) 


Hence differential ‘of a function is product of the derivative of this 
function and the increment of the independent variable, so that for example 


d sin x = cos x Ax, 


ie. 
_ AD 


etc: It means that in order to define differential of a function it is 
necessary to know the initial value of the independent variable x and 
its increment Ax; only thereafter it is possible to define fully the 
differential of a function and evaluate it. 
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We have seen above that if the increment Ay of the function 
can be represented in the form (2), then the first term on the right- 
hand side is cqual to y’Ax = dy; therefore differential of the function 
at a given point can simply be defined as a quantity proportional to 
Ax which differs form Ay by an infinitesimal of a higher order as 
compared to Ax. Such a quantity is often called principal linear part 
of the increment Ay. We can therefore say that differential of a 
function (for given x and Ax) is principal linear part of its increment. We 
can also sce that iu order that a function should be differentiable at the given 


point it is necessary and sufficient that its increment should have a principal 
linear part. 


This definition defining a differcntial as principal linear part of 
the increment is very important, for it serves as the basis of the most 
important application of differentials. We shall later see that 
existence of derivatives and existence of principal linear part of the 
increment are no longer equivalent requirements for functions of 
several variables; it is noteworthy that the, most natural definition 
of differentiability of a function in such cases is, as we shall see later, 
not the existence of derivative but the existence of principal linear 
part of the increment. 


The theoretical and the immediate practical (caJculative) 
significance of a differential is mostly based on formula (3). The 
dependence of Ay on Ax isgenerally rather complicated and calcula- 
tion of the accurate value of A y for given x and Ax is rather difficult. 
The relation (3) however, shows, that if Ax is small, the approximate 
evaluation of Ay can be successfully replaced by evaluation of dy, 
for the difference between these quantities (i.e. the error due to this 
replacement) is an infinitesimal of a higher order as compared to 
Ax and therefore comprises only of a negligible part of the evalu- 
ated quantity for small Ax (provided, of course, that y’ 4 0(, Asa 
rule it is always much simpler,to evaluate dy than A y, for the 
dependence of dy on Ax is linear. 


Let us now consider a simple example. Let us assume that we 


want to evaluate approximately the expression In (2 + «), where « is 
very small. 


The differential of the function Inx is equal to Ax/x; when 


x = 2, this differential is equal to Ax/2; _ therefore assuming that 
Ax = « we find from formula (3) 


n(2+4) —In2= 5 +0 (a) 
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and therfore 
In (2 + «) = In2 + > + 0(a); 


thus by knowing In 2 we can immediately find the value of In (2 + «) 
with a good approximation for sufficiently small values of «; thus 


In 2.001 & In 2 + 0.0005, 
In 2.002 & In 2 + 0.001, 
In 2.003 ~ In 2 + 0.0015, 


etc. It is clear that this method is very useful, for example, for 
compilation of logarithmic tables. Obviously in every case an 
assessment of the error o( Ax) incurred as a result of replacement of 
the increment of the function A y by its differential dy must be given. 
This assessment necessitates further development of the theory and 
we shall find later on that it can be found. The student will find 
useful exercises in the problem book by B P. Demidovich, Section 
II, Nos. 144, 145, 159, 160, 164. 


Since derivative of the function y = x is equal to unity for 
every value of x, therefore differential of this function is simply equal 
to Ax for every value of x so that the increment and differential of 
the function y = x coincide*) : 


Ax = dx; 


we can therefore replace Ax by dx in the expression for differential 
of an arbitrary function y = f(x); this gives 


dy = 9’ dx, 
and therefore 


a Ds (4) 


the derivative is equal to the ratio of differential of the function to differential 
of the independent variable. The expression (4) for the derivative is 
very convenient, for its symbols are used as much as the symbols 9’ 
and f'(x); it is, of course, somewhat more complicated but its advan- 
tage is due to the fact that it clearly shows the variable x with 
respect to which we differeetiate. This is particularly important in 
cases where the problems includes derivatives of one function with 





*) This evidently also applies to every linear function y = «x -+ 8B. 
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respect to different variables. Thus when we differentiate a compo- 
site function given by a twoelink chain y = f(u), u = 9 (x) (§ 29), 
we must deal with derivatives of y with respect to the independent 
variable x and to the intermediate function u; the notation »’ is here 
less convenient, for it does not directly show which of the derivatives 
in question it symbolises; on the othcr hand, by using thc notation 
(4) we write in such cases dy/dz and dy/du rcspectively and directly 
see with respcct to which variable we differentiate (the notation 
dy/du requires further explanations which will be given in § 33). 


The relation (4) is of utmost importance in further development 
of differential calculus as we shall see in the following paragraphs. 


§ 32. Geonietrical illustration and Jaws for evaluation. 


Like any other quantity which is determined by the course of 
the function y = f(x) the graphical representation of differential of 
this function should present an appropriate geometrical picture. Fig. 15 
represents a detail of Fig. 12. Here MT represents the tangent to 
the curve y = f(x) at the point Mf with co- 
ordinates (x,y). In the right-angled triangle 
MTP the side TP adjacent to the right angle 
is equal to the side MP, which is also adja- 
cent to the right angle, multiplied by the 
tangent of the angle a; but MP = Ax, tan 
“a= y’ = f’(x); therefore 


TP =7 AX=(f' (*) Ax = gy; 


thus in our diagram the differential of the 
function y = f(x) which corresponds to the 
given valucs of z ae Ax is represented by TP 
*—-Ox —-—sP — which is evidently equal to the increment of 
Tgets: the ordinate of the tangent MT from x to 
x + Ax (at the same time the increment of 
the ordinate of the curve y = f(x) itself along the same path). Since 
Ax = dx, so the relation (4) §31 of the derivative and the differen- 
tial is given in fig. 15 by an elementary trignometrical formula 





gee 
tan = VP? 


which connects the sides adjacent to the right angle in a right-angled 
triangle with one of its acute angles. 
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The mechanical illustration of a differential is also intcresting. 
Ifs = f(t) is the law of motion of a body, then, as we know 
(cf. §26), s’ = f’ (f) represents the instantaneous velocity of this 
motion at the instant 4. The differential of the path 

ds=s' At=/f'(t) at 

is therefore equal to the length of the path covered by the body if at 
the instant Aé it is moving with the same velocity as at the moment ¢ 
(i.e. if its velocity from the instant ¢ onwards remains unchanged 
during the time interval At). When we say that the car moves at a 
given instant with the velocity of 40 km per hour, we really mean 
that it has covered a distance of 40 km during the past hour 
provided it constantly maintained the same speed as at the given 
instant. Hence this number (40 km) represents the diffcrential of 
the path covered by the car at the given instant (when Aé =I hour). 


Finding differential of a given function, like finding its deriva- 
tive, is known as differentiation of this function; the fact, that these two 
operations are known by the same name is natural and intelligible : 
if the derivative y’ is known, then in order to obtain differential dy it 
is sufficient to multiply it by the given number Ax which is given 
quite independent of x so that, evidently, no further analytjcal 
calculations are necessary. All differentiation laws (both general and 
special) which we have established in §29 can be converted into laws 
for evaluation of differentials on simply multiplying the corresponding 
equation by Ax = dy. Thus, for example, if y = sin x, we find 
from - 


that 


dy = cosxdx; 
if y = In x, we obtain similarly from »’ = dy/dx = 1/x + 


eer 3 


ete. Ify =9, +r. + «- In, then it follows from the established 
law that 
y =F + 9’, Sees HD ai 


or, which is the same, 
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and on multiplying by dx we obtain : 
dy=dytdymnt...tdy 


(the law for finding differentials of an algebraicsum). On the basis 
of the corresponding laws for derivatives we can similarly establish 
differentiation laws for products or functions : 


d (uv) = udv+odu, 
d (Uy Ug ... Uy) = duy (uy «2. Un) 4 ty dU (Ug... Un) + 


+ uyunduy (uy... Un) + ue Huy, . Un-1 dn, 


u vdu—uduv 
a(+)= of 








For further useful examples cf. problem book by B. P. Demidovich, 
section IT, problem Nos. 151-156. 


§ 33. Invariant character of the relationship between a derivative 
and a differential 


_ We have seen that the differential and the increment are the 
same for an independent variable and, therefore, if x is the independent 
variable, the initial expression 


dy = f' (x) Ax (1) 


for the differential of the function » = f (*) can be written in the 
form 


dy =f" (x) ds. (2) 


Let us now assume that x is not the independent variable but 
is in its turn an arbitrary (differentiable) function of a new indepen- 
dent variable ¢: 


x= o(t). 


Since the differential and the increment of the function (in contrast 
to the independent variable) are, in general, no longer equal to one 
another, therefore, in this case dy 4 A x, and both relations (1) and 
(2) can thus no longer be right; only one relation is at best valid. 
We will show that, irrespective of the nature of the (differentiable) 
function 9 (¢), the relation (2) always remains valid. 


In fact, ify = f(x) and x= 9 (f), where ¢ is the independent 
variable, then we can regard y = f[9(t)] as a composite function of ¢. 
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As we know, the derivative of this function is equal to /’ (x) 9’ (¢) and 
therefore its differential is equal to 


dy =f" (x) 9'(t) db; (3) 
but, on the other hand, we have x = 9 (¢) and therefore 
dx = 9'(t) dt; 


hence it follows from (3) that 


dy = f '(x) dx, 


which was to be proved. 


Thus the relation (2), or its equivalent relation 


applies in both cases irrespective of the fact whether x is the indepen- 
dent variable or an arbitrary function of another quantity. This 
relationship between a derivative and a differential is said to be 
invariant (unalterable) with respect to any transformation of the independent 
variable. 


lane) 
It is interesting to note that in the light of this invariance the 
law of differentiation of a composite function 


d , ; 

> ae OLA) 
can be written in the form 

Toe di (a 
for we. have shown that f’ (x)= dy/dx; the law obviously appears 
trivial in this from; however, it would be wrong to prove this law on 
the basis of the relation (4), for the relation (4) is itself obtained as a 


corollary of the invariance of the relation (2), in whose proof we 
already used the law for differentiation of composite functions. 


CHAPTER VIII 
DERIVATIVES AND DIFFERENTIALS OF HIGHER ORDERS 


§ 34. Derivatives of higher orders 


The derivative »’ = f'(«) of the function _y = f(x) isa function of 
the variable x on which y depends; the problem of differentiating y’ 
can therefore arise. If y’=f'(x) has a derivative, then this derivative 
is denoted as follows : y“=/"(x) and known as the second derivative or 
the derivative of second order of the function y= f(x). Similarly the deri- 
vative of the function y”, if it exists, is known as the third derivatlve 
of the initial function y = f(x); in general, if the'nth derivative y™ 
=f™ (x) of the function y exists and is defined and if the function y ™ is 
differentiable, then its derivative is denoted by y +) = f+) (x) and is 
known as the (n+1)—th derivative (or as the derivative of (n+ 1)—th 
order) of the initial function y = f(x). 


Derivatives of higher orders occur quite frequently in many 
problems of accurate natural study, technical processes and other 
scientific and practical branches. ‘Therefore the ability to find them 
and the knowledge of their properties is not' offly necessary for mathe- 
maticians but also for scientists in every branch where mathematical 
analysis finds application. We have seen in § 26 that ifs = f(t) is the 
law of motion of a body, then s’= f’ (t) cxpresses the instantaneous 
velocity v (¢) of this motion at the instant ¢. The second derivative 
s” = f" (t) =u '(t), ue. the derivative of the instantaneous velocity, 
denctes the “rate of. change of velocity”; in mechanics this quantity is 
known as acceleration ; its importance is very great mainly because, 
according to the well-known Newton’s law, acceleration is proportional 
to the acting force ; the majority of mechanical problems are phrased 
in such a way that the acting forces are given and the motion due to 
their action is to be found; but giving acceleration is equivalent to 
giving of the acting force and therefore a typical mechanical problem 
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involves establishment of the character of motion from the given 
acceleration. The second derivative has several important geometri- 
cal applications which we shall learn later. 

It is obvious that in order to find derivatives of higher orders it 
is only necessary to perform successively a series of ordinary differenti- 
ations and so no other new methods are needed. Here we shall only 
note several interesting results for some elementary functions. 

1. We have seen in § 29 that derivative of a polynomial y= 
gx" + ayx™-1 + ... +a, is a polynomial of degree one less than the 
degree of the given polynomial and has the leading term nagx""'; 
eachnew differentiation lowers the degree by one each time ; thus 
the derivative of the nth order 


y ™ =nlag 


is a polynomial of order 0, 7 ¢. a constant ; therefore 


y (n+1) ee =... = 0, 


7.¢. for a polynomial of the nth degree the derivatives of all orders greater than 
n are identically equal to zero. 


2. We know that the function y = ¢* remains unchanged by 
differentiation (y ‘= y). Therefore evidently y' = y = e” for any n. 
More generally, if y= a, we have y’ = In a, and therefore y' = 
y (In a)"=a® (In a)" for any n. 

3. The derivative of the function y =sin x is y’ == cos x and that 
of the function z = cos x is z’ = — sin x; hence 

yp" = —sinx, y= —cosx, y™ = sina, y = cos x... 5 
the successive derivatives of the function sin x form, as we can sce, a 
periodic series with a period of 4, so that for any n 


y 4m) = sin x, 9 AMD = cos x, y ENF?) == — sin x, y Gadd) == — cog x ¢ 


and similarly for the function z = cos x : 


24) = cos x, 2 44) = — sin x, 74") = -cos x, zt) = sin x; 


this is the same series as above but it has shifted by one position. 


4. The derivatives of the functions In x, arctan x and arccot «x 
are, as we know, expressed in terms of rational fractions ; therefore it 
evidently follows that the derivatives of all orders of these functions 
will also be rational fractions ; similarly the derivatives of all orders 
of the functions arcsin x and arccos x are algebraic functions. 
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5. We know that the first derivative of every elementary func- 
tion is in general also an elementary function; it therefore evidently 
follows that the derivatives of all orders of elementary functions are 
always elementary functions. 


6. The law of differentiation of an algebraic sum can evidently 
be extended without changes to derivatives of all orders. However, 
the second differentiation of product of two functions deserves special 
attention : if y= wv, where u and v are differentiable functions of x, then, 
as we know, 

yy =u’ +u'~" 


and it can readily be seen that 
cy” = uv" + Quo’ + u"2, 
ye =u’ + 3u'o" + 3u"o’ + u'2, 
which makes it reasonable to assume that for every n 
YO = anquy™ + agyu’o!™—Y) 4 ang” +4... 
ot aay! + an,u™a, (1) 


where “no, “nis «+> “nn are constants independent of the form of the 
functions u and v; this proposition which we have already proved for 
=1, 2 and 3, can readily be proved, for every x by the method of 
induction, (we leave the proof to the reader). The numbers “no, “nz, 
.+> “an Must only be found. Since these numbers are independent of 
the form of the functions u and 2, they can be chosen specially. Assurn- 
ing that 
U2 0 ee, 


where ¢ is an arbitrary constant, we find that 


un) — é, yO = iret, 
y= ela, la) = (t + 1) elt, 
and formula (1) gives : 
(E+ D)metD? = gq, geteel® 4 on eteMlete +4. 
+ angetl™Fel® 4 4 otanetel® = 


a t+1)a/ = 
= ED Ghagt” + oat”) + angi? +... + ong), 


and therefore 


(f+ 1)” = atygl™ + pt?! 4 oygé®® 4 .., + ony 


DERIVATIVES AND DIFFERENTIALS 139 


where the number ¢ is arbitrary ; comparing this formula with the ex- 
pansion of (¢ + 1)" by the binomial formula we can see that two 
polynomials which are identically equal should have similar corres- 
ponding coefficients in pairs and therefore 


and formula (1) gives : 
Bae a= Coug) + Clu! yD +e. of Cy uml) »! + Grae) v. 


This is the so-called Leibnitz formula which gives the nth deriva- 
tive of a product of two functions in terms of the derivatives of the 
factors up to nth order inclusively. 


§ 35. Differentials of higher orders and their relationship 
with derivatives 


Differentials of higher orders are determined just as derivatives. 
The second differential d°y of the function _» = f(x) is the differential 
of the first differential 


d?y = d (dy); 


and, in general, if the differential dy of order of the function y is 


already determined, then 
d"t}y = d(d"y). 


Since dy is by definition a function of two independent variables, viz. 
x and Ax, the expression d (dy), with whose help the second differen- 
tial d? y is determined, requires some explanation ; while performing 
the operation d (dy) we are always considcring dy as a function of x 
alone by assuming Ax to be constant; this remark also applies to all 
subsequent differentials and Ax is assumed to be onc and the same 
for differentials of all orders. 


In order to establish a relationship between differentials of higher 
orders and the corresponding derivatives let us at first recall that 


dy i al AX, 


i.e. the formation of a differential of a given function y involves 
multiplication of its derivative with respect to x and the increment 
4x of the independent variable and, as we have alrcady emphasized 
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on many occasions, the quantities x and Ax should be regarded as 
independent of one another. Thus in order to find the second differ- 
ential d*y = d (dy) of the function y we must find the derivative dy 
with respect to x and multiply it by Ax. But dy = Ax, where 
the second factor isindependent of x and in differentiation of product 
with respect to x it should be regarded as a constant ; the derivative 
of dy =» Ax with respect to x is therefore equal to ”“ Ax and 
hence 
d?y =d (dy) = 9" (Asy; 


repetition of this operation evidently gives 
d°y = y"" (Ax), 
and in general 
d™y = 9 ™ (Ax); 


the differential of order n is equal to the derivative of the same order multiplied 
by the nth power of the increment Ax. Conversely, it gives 


=22 (1) 


where the donominator should be regarded as (dx)" but, for the sake 
of simplicity of notation, brackets are always omitted. ‘Thus the 
derivative of order nis equal to the differential of the same order divided by the 
nth power of the( first) differential of the independent variable. 


Formula (1) is a generalisation of the formula y = dy/dx and, 
like this formula, can in many instances serve as a vcry convenient 
method of notation for derivatives of higher orders. However, the 
formula y’ = dy/dx is, as we know, invariant with respect to every 
transformation of the independent varialsle (7.e. it remains valid even 
when x is not the independent variable but a function of a new 
variable ¢); formula (1), no longer possesses this invariance property 
for n>1, and essentially depends on the fact that x is the independent 
variable. In fact, we will show that formula (1) is in general not 
valid for n = 2 ifx = 9(t). We know that in this case (assuming 


that y = f(x) 
dy = f" (x) dx = f’ [oe (t)] 9° (é) dé. 
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While taking the second differential d*y = d(dy ) we should differen- 
tiate dy with respect to /and multiply the result by dit. This gives 


dy ={f" [e(QlePO+f/ ele} de = 
=f" fol [e ae +f' lee" (de? =f"(x)dx? +f" (x)d2x, 
since 9’ (t) di = dx and 9"(t) dt? = d?x. We therefore obtain 


oa reais 
Saf M+r wa, 


whereas if x is the independent variable we have 


the additional term 





appears as a result of the fact that x is now a function of the inde- 
pendent variable /; in fact, if x is the independent variable, then 
dx = Ax,d?x = 0 and the additional term is absent. 


We have already said that finding differentials and derivatives 
of higher orders does not necessitate any fundamentally new methods 
and therefore not many exercises are needed. The student will find 
many interesting problems in the problem book by B. P. Demidevich, 
section II, §5. : 


CHAPTER IX. 


MEAN VALUE THEOREMS 


§ 36. Theorem on finite increments 


In the last three chapters we have studied practical operations 
of differentiation. We have learnt how to find derivatives and 
differentials, and the theorems proved there are mainly designed to 
help and fecilitate this process. As we have done all this and learnt 
the technique of differentiation, we must study some further proper- 
ties of derivatives and differentials, i.e. we must study the properties 
which form the theoretical basis of differential calculus. Amnog the 
laws which we shall study as such a prominent part is played by 
several theorems which can be given the common name “‘mean value 
theorems’; this title in general involves propositions which imply 
existence, under specific conditions, of a given point ¢ (or ‘‘mean 
value’) in the given interval (a, 5) at which the given function 
possesses certain properties. We have already met one such theorem 
in Chapter 5 (theorem 3 §23) : if the function f(x) is continuous in 
the interval (a, 6) and has opposite signs on its ends, then a point ¢ 
can be found in this section such that f(¢) = 0. The main charac- 
teristic of theorems of this type is due to the fact that they do not 
give any indications as to the position of the point ¢ in the interval 
(a, b) but only prove the mere fact of its existence. We shall now 
establish several such theorems for the function f(x) which is differen- 
tiable at every point in the interval (a, 6) and in every case we shall 
assume that lim A _y/A.x exists at the point a only for Ax > + 0 and 
at the point 4 only for Ax > — 0, 


Let us at first prove an auxiliary proposition which we shall 
find useful later. 
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Lemma. Jf the function f(x) has a derinative at the point x and if 
the following inequalities holds 


S(e +h) <flx), fle — hk) < f(x) (1) 
for all sufficiently small h>0, then f'(x) = 0. 


Proof. It is given that /’(*) exists; therefore for h > + 0 we 
should have : 


NiCaen Net ) pg, L= ve LO) _, iy; 








the first of these fractions, as a result of the statement of the lemma, 
cannot be positive for a sufficiently small A and therefore (corollary 2, 
theorem 2 $10) its limit must also be /’ (x) <0; similarly the 
second fraction cannot be negative for a sufficiently small h and 
therefore its limit must bef’ (*) > 0; hence the derivative f’ (x) can 
neither be positive nor negative and it must therefore be equal to 
zero. 





Fig. 16. Fig. 17. 


This lemma means that al the point where the function acquires its 
maximum value as compared to an adjacent value, the derivative, in case it 
exists, Should be equal to zero. ‘Vhe lemma evidently remains valid also 
when the value of the function f(x) attains its minimum at the point «x 
as compared to an adjacent value, z.e. when the inequalities (1) are 
replaced by opposite inequalities. This lemma can be geometrically 
illustrated by representing y = f(x) in the graphical form (Fig. 16) : 
at the point where the curve y = f(x) attains its highest or lowest 
position as compared with its immediate neighbourhood, the tangent, 
in case it exists, should be parallel to the OX-axis; in this event we 
do not exclude the case when the function also has the same values 
(as at the point x) at other points which can be as close to x as we 
please (or which can be sufficiently close to x); thus for the function 
represented in Fig. 17 the statement expressed by the lemma remains 
valid for every point on the line (a, 4). 
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Theorem (Rolle’s). If f(a) = f(b) and the function f(x) is conti- 


nuous in the interval (a,b) and differentiable at every point in ‘that interval, 
then an intertor point ¢ can be found in the interval (a, 6) at which f' (c) =0. 


Proof. Let us assume that f(a) = (5) = Y for all points x in 
the interval (a, 6), z.¢., the function f(x) is constant in that interval, 
then f’(x) = 0 at cvery point x in thatinterval. Otherwise the 
interval (a, 6) will contain points at which f(x) > Y or other points 
at which f(«) < Y (it may, of course, happen that neither points 
exist), For the sake of argument let us assume that there exist points 
for which f(x) > Y. 


Since the function /() is continuous in the interval (a, d), 
therefore, according to theorem 2 § 23, it should attain its maximum 
value at a point ¢ in that interval ; it is 
evident that f(c) > Y ; therefore the 
point ¢ does not coincide with a or b, 
?.€. it is an interior point of the interval 
(a, 6); it follows from the definition of 
the point ¢ that for all points in the 
interval (a, 6), including all the points 
x situated sufficiently close to the point 
c, we have f(x) </f(c); hence applying 
the lemma we have f'(c) = 0 and the 
theorem is thus proved. 





Fig. 18. 


The geometrical illustration of Rolle’s theorem is evidently 
based on the fact that between two points on the given curve, situated 
on the same level, a point can always be found so that the tangent at 
this pointis horizonal (Fig. 18) ; in this case we assume that a tangent 
at every point exists on the given section of the curve. 

Theorem (Lagrange, on finite increments). If the function f(x) 
is continuous in the internal (a, 6) and differentiable at every intertor point 
of this internal, then a point c can be found 
in this interval at which y 


f(b) — fla). ‘ (2) 


b—a 


I’ (ce) = 
Owing to the fact that 


IAD) I NGY. 


pare 





is the slope of the chord joining the 0 
points [a, f(a)] and [6, f(5)] of the Fig. 19. 
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curve » = f(x) (Fig. 19), therefore from a geometrical point of view 
Lagrange’s theorem maintains that for a curve which has a tangent 
at every point, a point can be found between the endsof every chord 
at which the tangent will be parallel to the chord. It is evident that 
Rolle’s theorem is a particular case of Lagrange’s theorem when 
the given chord is parallel to the O.X-axis. 


It is obvious from the geometrical representation that the 
general case can be deduced from the particular one simply by 
turning the diagram and therefore the analytical proof should also 
not be complicated if we base it on Rolle’s theorem. 


Proof. Let us consider the auxiliary function 
b) — 
a(s)= fis) ~ fy — FO TIO ea, 


which geometrically represents the difference between the ordinate of 
a curve and ordinate of the chord as shown in Fig. 19. Evidently 
o (a) = 2(6) = 0; on the other hand the function ¢(x), like the 
function f(x), is continuous in interval (a, 6) and differentiable at 
every point of this interval, and 


; ' (6) — f(a) 

e’ = f(x) — 4 I). 

If follows from Rolle’s theorem that a point ¢ can be found in the 
interval (a, 6) such that 


— f(b 
e'@ =f (g—-FI=M) m0, 


which prove Lagrange’s theorem. 


This is one of the most important theorems of differential 
calculus and we shall frequently use it. The relation (2) stated by 
this theorem is sometimes, for the sake of convenience, written in the 


form 
S (6) — fla) = f' (c) (6-4). (3) 


The meaning of this statement is not altered in any way by the fact 
that if the function f(x) has a derivative at every point in the 
internal (a, 6), then a point c can be found between a and 6 at which 


the relation (3) holds. 
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Let us finally rewrite the same relation in a different notation. 
Let us write x instead of a and + Ax instead of 6, where b—a= Ax; 
we thus obtain : 


fet ax) —flt) =f' () Ae (x <e < e+ Ad). 


If we denote f (x) by 7, then it is convenient to denote the left- 
hand side of this relation by A 3, as we did in the past. It is also 
convenient to denote the point c, about which we only know that it 
lies between * and x + Ax, by x + 9 Ax. if we agree that § denotes 
a number (unknown) which lies between 0 and 1 (0 < @ <1). Our 
relation thus becomes 


Ay =flx + Ax) — f(x) =f! (x + 6 Ax) Ax (4) 


It is interesting to compare this equation with another equation 
which we have used several times in chapter 7 : 


Ay =f (*) Ax +0 (Ax); 


this relation shows that the increment A ) of the function » = f (x) 
is equal to product f’ (x) Ax with an accuracy up to infinitely small 
quantities of higher orders; the equation (4) (i.e. the theorem on 
finite increments) shows that in this expression the term o(Ax) can 
be completely rejected but that in the main term the derivative f’(x) 
must be replaced by a derivative at some (unknown) point x + §Ax 
which lies between « and x + Ax; both relations are very useful and 
have many applications. 


The following theorem is an important generalisation of Lag- 
range’s theorem : 


Theorem (Cauchy). Jf the functions f (x) and © (x) are continuous 
in the interval (a, b) and differentiable at every point in that interval where 
p’ (x) O(a < x < 4), then a point c (a << c¢ < bd) extsts such that 


Sb) — fla) _ file) 5 
2(6) — @ (a) ~ oe)’ (5) 


(i.e. the ratio of increments of two functions is equal to the ratio of 
their derivatives at one and the same point in a given interval), 


The proof of this theorem can be carried out in exactly the 
same way as the proof of Lagrange’s theorem. The following func- 
tion should be taken as the auxiliary function 


Suc ti TOL ; 
PAS) f (a) 9 (b) — IO ames 
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‘{p(b) — (a) + 0, since otherwise, in accordance with Rolle’s 

‘theorem, we would have 9’ (c) = Oat a pointe (a < ¢ <b) which 

-contradicts the conditions of the theorern]; all other arguments are. 
‘the same as above and give us the relation 


nt OHIO: Sex Gy 
FO ea O =o - CSee4. 


“from which (5) follows. 


It is evident that Cauchy’s theorem becomes Lagrange’s theorem 
‘when we choose ¢{*) = x and is, in fact, a generalisation of this 
‘theorem. 


We have already said that the theorems studied in this para- 
-graph have many applications in analysis. We shal] now consider a 
‘simple but very important example of this kind of application. 


We know that the derivative of a constant is equal to zero. Is 
the converse also true, t.¢. can we say that the function #(*) whose 
-derivative at every point of a given interval is equal to zero is cons- 
tant in that interval ? To answer this question let us take two arbi-’ 
trary points x, and wv, in the given interval; it follows from 
Lagrange’s theorem that 


F (x2) -- f (x1) =f" (6) (v2 — ¥); 


‘where ¢ is a point between x, and x, ; but we have assumed that 

_f'(x)=0 at every point x in our.interval and therefore also f’ (c) = 0, 
and hence f (x2) = f (x1); the values of the function f (x) are equal 
at two arbitrary points in the given interval] and this means that the 
function f(x) is constant in that imterval. We thus see that the 
theorem on finite increments enables us to prove the following impor- 
stant proposition which we shall frequently use : 


Theorem. If f '(x) = 0 at every point in the interval (a, b), then the 
function f (2) is constant in that interval. 
In the next two paragraphs we shall consider some other impor- 
tant applications of the proved mean value theorems. 


§ 37. Evaluation of limits of ratios of infinitely small and 
infinitely large quantities 


_ While considering the general theory of limits (chapter 2) we have 
-said that the ratio of two infinitely small quantities (of infinitely large 
quantities) can in a given process have a very diverse character of change 
an relation to the nature ofthe infinitely small (or infinitely large) quan- 
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tities so that we cannot make any general predictions as to the beha~ 
viour of ratios of this type. At the same time the true value of these 
ratios is very important : thus, as we now know, the derivative of a 
given function, which is the fundamental concept in differential cal- 
culus, is defined as limit of a ratio of infinitesimals. It is therefore 
clear how valuable is to find a more or less general method for 
evaluating limits of such ratios in case they exist. One such very 
useful and at the same time simple and powerful method can be 
developed on the basis of mean value theorems which have been 
proved in the previous paragraph. We shall now consider this 
method. 


Let us assume that the point a belongs (i.e. it lies on or is one 
of the ends) to a segment A along which the functions /y (x) and f (x): 
are continuous; let /; (2) =f, (2) = 0, where both functions are: 
differentiable at every point in this segment and f’s (x) ~ 0. In that 
case fi, (x) + 0 (x 4 a) along A, for otherwise, in accordance with 
Rolle’s theorem, f’2 (x) would vanish at a point in the segment A 
other than the point a. We can therefore consider the ratio. 
F1(x)/fo(x) of two infinitely small quantities and trv to find: its limit 
forx >a. Since f; (a) = f, (a) = 0, therefore 


Sits) _— fale) — fy (2) ; 
Fealx) fel) — fe (a) ’ 


it follows from Cauchy’s theorem proved in § 26 that all requirements: 
are evidently satisfied in this case and therefore 


Jil~) . £19) 
Fe (x) Sie (6) ’ 
where c is some point (‘‘mean value’’) between a and x. Let it now 


be known that the ratio /"; (x) / f’, (x) tends to a certain limit / for 
x -> a; since ¢ lies between a and x, therefore for x > aandc—> awe 





(I) 





have 

tc 

pag eee 
and equation (1) also shows that 

nal >t (x->a). 


We have thus proved a theorem known as I’Hospital’s rule r 


Let fy (a) = fe (a). = O and let the functions fy (x) and J, (x) be 


continuous along a segment A on which the point a is situated; if in this case’ 
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S's (x) and f', (x) exist for all points x 4a along the sgement A, f's(x) 40 
(x <4 a) and f'y (x) / f'o(x) > Ll for xa, then fy (x) /fo(x)—>l for xa. 


The significance of this rule is due to the fact that in many cases 
the limit of the ratio of derivatives can be found much more easily 
‘than the limit of the ratio of the functions themselves; it may happen 
in some cases that one or other derivative is no longer infinitely small 
for x — a; in that case we are no longer dealing a ratio of infinitely 
small quantities and the limit can be found quite easily. 


Example I. When 6+ 0,x*—0, 





‘im sin ax . acosaxr a 
im -—— = lim ,—— = —. 
sin bx & cos bx b 
1 
— 
. tanx—wN . cos’ x 
Example 2. When x > 0, lim ———— = lin ————— = 
: v— sin x I—cos x 
. 1 — cos? x . I+ cosx 
-= lim pg ee Diy © erage Se 
cos* x (1 — cos.) cos*® x 


Many other useful exercises can be found in the problem book 
‘by B.P. Demidovich, Section IT, § 10. 


If both derivatives f{’; (x) and f's (x) are infinitely small for 
x -> aand are in their turn differentiable in the neighbourhood of a 
point a (where /”» (x) does not vanish for x 4 a), there is no reason 
~why LDHospital’s rule should not be applied again: if we have 
S's (x) / £2 (x) 1, for x > a, then according to this rule we also 
have f’1(x)/f’s (x) ~ J and thereforealso f; (x) / f2 (x) / forx—>a. 
In general, if-the functions f,(x) and /» (x) have derivatives of order 
nin some neighbourhood of the point a, where f,‘") (x) 40 for x 4a 
and f(a) =f2 (= f's (a) =f'2 (a=. = fi" (@) = fe Ma)= 0, 
then by applying l’Hospital’s rule for the second time we can evidently 
conclude that if the following relation exists 


; Jie (x) 
lim J2 0 =, 
lif 


then the limit of the ratio fj (x) / fs. (x) for x > @ also exists and is 
-equal to /*). 

*) The relation necessary for the application of l’Hospital’s rule for the second 
-time, i.e. fo) (x) 0 (10k <n, x 5 a) for k = nis one of the assumptions of the 
‘theorem and can readily be established for lower values of k by the method of 
‘induction, applying Rolle’s theorem to the function f2) (x) along the line (a, x). 
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Example 3. /, (x) = x —sin x, fs (x) = 4° ; we have 
f'1@) = 1—cosx, "1, (x) = sin x, fs (x) = cos x, 
S'e(x) = 3x4, f's (x) = 6x, fs (x) = 6 
and therefore 
Fx: (0) = (1 O = 7", (0) = 0, fs (0) = I, 
Fo (0) = f'2 0) = f'2(0)= 0, fs (0) = 6, 





fr (x) ame are L (x — 0) 


and hence also 


fi (x) x—sin« & 
Fox me a 6 
L’Hospital’s rule remains valid when .+— oo. Thus, forexample,. 
if the functions f, (x) and /, (x) are infinitely small for « — + 
and differentiable for sufficiently large x and f’s (x) = 0, then it 
follows form 





(x > 0). 


I (x) ee As : 
Hy OES! (2) 


that we also have 





Si (x) 
- ay ei (x > + o) 


In fact, assuming that v == 1 / » we have: 


1 
tan oe) ib ies 
fol), ~ O2(9) 
fils) 
and for 4 >+0 
o1{9) > 0, o2 (9) > 0. 


Since 
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it follows from (2) that 





27 (9) ; 
G's (y) > t (y me ss 0) > 
and therefore on the basis of l’Hospital’s rule we have 


A (9) 


oo) >t (y> +9); 


and this is equivalent to the relation 





Ai (*) ; 
Fe) —>l (vx > + o). 
Example 4. When x—> + ow, 
= a arctan ¥ —_ oy 
lim + (4 — arctan x) = lim 1 = lm =a = 
x 
: x? 
= lim eed => 1. 


Let us now consider a ratio of two infinitely large quantities. We 
shall see that |’Hospital’s rule also remains valid in this case, although 
the proof is somewhat more complicated. Let us assume that we have 


lA@l[>eto, |feW|>+o (xa), 


and let, as before, both functions be differentiable in a neighbourhood 
of the point a, where /’, (x) # 0 for all x 4 0. Let us take two 
points « and «@ in this neighbourhood, both situated on the same side 
of the point a so that, for example, a<x<«. It follows from 
Cauchy’s theorem that 


where x <.¢ <.«. But on the other hand 


1 uss a (x) 
Fir (x) — fi (%) i Fx (x) _Sxt(x) * 


Sa (x) — fe (2) Fo (x) 1 — £2 (a) ° 
SF (x) 
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and comparison of these two equations gives: 


_ fs (ct) 











Fils) — £16) | 7 Fel) 3) 
Sa (x) fix(e) y_ fr la)” 
Fx (x) 
Let us now assume that the following limit exists : 





Let e > 0 be as small as we please; let us choose « so close to a that 
fora<zg<« 


| S's (2) 
Hoe ce Sh ey 
| fie) | 
or, which is the same, 
fy () 
Loe See ol f, 
AC ea 
so that the point ¢ should lie between a and « and 
F'1 (c) 
I—ze < %, <ZI+te 4 
Se (¢) (4) 


(as x changes, ¢ will also change, but since it always remains confined 
between a and «, the inequalities (4) remain valid). Let us now 
assume that while « remains unchanged, x tends to a; it then follows 
from our assumptions that in this case | fy (x) |—-> + © and 
| fe (x) | > + oo, and therefore the second factor on the righ-hand 
side of the relation (3) will tend to unity; it can be represented in the 
form / -++ 5, where 8 ~ 0 for x > a. Multiplying both sides of the 
inequalities (4) by this factor we obtain as a result of the relation (3): 


Si (x) 
Ss (x) 


since the number ¢ is as smal]l as we please and 8 — 0 for x > a, it 
evidently follows that 


(1 + 8) —s) < <(1+8)(l+6): 


Si (x) i 


Se (x) ads 


which was to be proved. 


(x > a), 
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Example 5. In x —~ — oo for x > 0. Hence it cannot be 
immediately seen as to how vlnx behaves. In order to study this 
behaviour we note that 


can be represented as a ratio of two infinitely large quantities; the 
- derivatives of the numerator and denominator are respectively equal 
to — 1/x and — 1/x? and their ratio is equal to x and tends to 
zero ; it therefore follows from 1’ Hospital’s rule that 


xInx—> 0 “x — 0). 


As before, it could readily be proved that lHospital’s rule 
remains valid for the ratio of two infinitely large quantities when x 
- does not tend to a finite limit but increases indefinitely. 


Example 6. For x + o» 


-and generally (x > 0) for x — 2% 


] 


Ins ® 


: [ 
vt , = lim pote 0. 


. . x 
lim = lm P= 

Example 7. Let a > 1, « > 0. The functions x* and a’? 
increase indefinitely for x > + oc. Let n be the greatest integer 
smaller than «, so thatO <n<a<qQnu-+1. Itcan readily be seen 
that all derivative of the function +%, up to and including the nth 
- order increase indefinitely for x — 00, whereas the derivative of order 
.n +1 is equal to a (2 — 1)... (2 — n) x*"-" and remains bounded. 
Since then +1— the derivative of the function a* is equal to a*(In a)"t4 
and increases indefinitely for »—» + 00, therefore the application 


- of l’Hospital’s rule n + 1 times shows that 
ere 9 (x-> + cw) 


az 


for every ¢ > Oanda> 1. 
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§ 38. Taylor’s Formula 


We shall base our argument on the well-known relation estab-- 
lished in § 31: if the function / (x) has .a derivative at the point a, 
then 


flath)=fla +f’ (ahs oh) (1) 


for h + Owhen | /! is small; this relation enables us to express. 
approximately the value of f(a + #) in terms of a linear function, 
although this function has usually a rather complicated dependence 
on i 


fla +h) SSfla) + f(a) a, 


where the error of this approximate evaluation is of the form 0(h),. 
ie. this error is negligibly small for small values of h, not only in 
itself but also as compared to | hj. We have already learnt that 
this fact has a very great practical value, since it makes possible to 
find very readily a good approximation for the value of / (a + h) 
(c f. § 31). We shall now learn that this point serves as a basis for 
further development of the theory. 


About the quantity (of) in equation (1) we know only that it 
is an infinitely small quantity of a higher order as compared to h; we 
have no other accurate information about it. Hence the question 
how far formula (1) is suitable for approximate evaluation of 
f(a + A) depends entirely on the desired degree of accuracy. If the 
required degree of accuracy is such that a quantity of the type o(h) 
(z.e. an infinitely small quantity of a higher order as compared to h) 
can be neglected, then formula (1) solves our problem; otherwise it 
is not sufficiently accurate. It may happen (and it does frequently 
so) that we are obliged to take into account infinitely small quantities 
of second order with respect to A [i.e. quantities of the same order as 
h?); but we can disregard all quantities above the second order: 
(1.2. quantities of the type ofh®)]. In that case we shall look fora. 
more accurate expression for f (@ + fh) and use a formula similar to 
formula (1) 


SF {at h) = 4% +414 + a, h*® + o(h*), 


where «9 , %1, “2 are constants (independent of h), ze. we shall look 
for the approximate value of f (a + h) in the form of a trinomial of | 
second degree 


fla th) Sag t ayh+ o,h3, 
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in which the error is of the type o(h?), i.e. an infinitely smalli 
quantity above the second order as compared toh. At first we evi- 
dently know nothing about the existence of such a polynomial and 
we have no way of finding its coefficients «9, «;, «; therefore all that 
we have said in this connection can merely be regarded as the state-- 
ment of the problem. 


However, beefore attempting to solve this problem we will 
naturally state it in a more general form. The real nature of the 
problem for which we are trying to find an approximate value of the 
function f(a + fA) determines the required degree of accuracy. By 
making an assumption of a fairly general character we can then: 
decree that quantities of the order h" (where n is a constant natural 
number) should still be taken into account, but infinitely small’ 
quantities of higher orders (7.e. quantities of the type o (k") should be: 
neglected. The question arises whether 1) a polynomial of the nth, 
degree exists 


Pyl(A) =anptauzyh tosh? +... + anh" 
(with coefficients independent of h) so that 
f (a + h) — P,(h) =o (h”) (2) 


for h -» 0 and 2) if it does exist, then how we can find its coefficients. 
If the problem so stated can be satisfactorily solved, then the poly- 
nomial P,,() will enable us to find the value of f(a + ) with the 
required degree of accuracy : for practical calculations (and also for 
theoretical investigations) we know nothing more convenient andi 
simple than a polynomial. 


It can, of course, be foreseen that the answer to the above: 
questions will depend to a large extent on the nature of the function 
f(x) in the neighbourhood of the point a. Already in the case 
considered earlier for » = 1 we had to introduce the condition of 
differentiability of the function f(x) at the point a If we want to. 
express approximately the value of f (a + A) in terms of a polynomial 
of the nth degree with an accuracy up to quantities of the type o(/), 
we shall have to assume that the function f(x) has derivatives. 
of all orders up to the nth order inclusively at the point @ [in other 
words, we must assume existence of f(a)]. But this will be the 
only assumption we shall have to make. 
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We will now show that iff (a) exists, then we have 


flatA =f (a) +f" (a) h + pS" (a) AB + 


+ Fp (aya to(h*) (1) 
‘for h -> 9; in other words, the polynomial 
P(A) = flat f' (@ah+ =a a SU (@hete.. Pay J fo (a)h™ (3) 


‘satisfies the relation (2) for A -> 0 and thus solves our problem. 
Assuming that 


f (a +h) — P,, (h) = 0 (h), 
‘we must therefore show that 


9 {h) 


jn —> 0 (h — 0). 


But a simple calculation gives us i 





2 Uh) =f (ath) =f (a) Hf" (a) — Sf" (a). — 2 F (a), 
=f (ath " peer 
eS (a8) f(a) — = Gh 
po” (h) = f"'( a+h) —f" (a) — hf" (a) — men f' (a), 


2 
@ (n—2) (h) = fr (a + h) — fer (a) = ae (a) — = (nr) (a), 


@ (n—D) (h) ie eee (a a h) — fern (a) — hf™ (a), 
hence 


9 (0) = 9’ (0) = 9” (0) =... = 9 (0) = 0. 
*) It evidently follows from our assumption on existence of f (n) (a) 


that f (n— 1) (a +h) exists for a sufficiently small | 4 | and therefore also 
tine 
eats ae Ree ee ee 
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On the other hand, the function #” vanishes together with its deri- 
vatives up to the order n — 2 inclusively even for 2 — 0; the deri- 
vative of order n — 1 of this function is equal to n!h. Hence the: 
application of l’Hospital’s rule gives . 


er (n—1) (1) 


2) tim te (4), 


4730 a h-+9O 





provided the limit on the right-hand side of this equation exists. But. 


 (n-1) (A 1 (n—-1) + h) — (n-1 : 
nth at ¢ ; a F(a), ») 





and since by definition 


{n-1) — fin-l) 
f™ (a) = lim Ed (a+ e Bg Na) 
ho0 
therefore the right-hand side, and hence also the left-hand side of the- 
equation (5), tends to zero for h > 0; it therefore follows from (4) that. 


9 (h) 
ae — 0 (h — 0), 


which proves our statement. 


The formula (T) which we have thus established by assuming 
only the existence of f'™ (a) is usually known as Taplor’s formula.. 
This is one of the most important formulae of mathematical analysis. 
and has a great number of theoretical and practical applications, It 
is sometimes convenient to write it down with the help of other 
symbols : Let us agree to write xin place ofa + /; in this case h=x—a,. 
and formula (T) becomes 


F(x) = flay $F7 (a) (x0) + 7 | 


—a)?+... 
. (a) 


ni 


(x — a)" + o[(x —a)"]. 


In a particular case when a = 0, we obtain the so-called Maclaurin- 
Sormula 


Fla) =f O)+S (Ox EI) wt. AAI) at 0 (00, 


which approximately represents the function f(x) in the form of a. 
polynomial in powers of x for small absolute values of x. 
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We have thus found that Taylor’s polynomial (3) solves our 
problem of the approximate expression of f(a + A) in the form of a 
polynomial of the nth degree, i.e. it satisfies the relation (2). We 
will now show that this solution of the problem is unique, 7.e. no 
other polynomial Q,,(%) of a degree not higher than x exists, for which 
we can also have 


F(a + h) — Qn (h) = 0 (h”) (6) 
for h > 0. In fact, if such a polynomial Q,, (A) exists, then it would 
follow from (2) and (6) that 
beet (h) ar Qn (h) ae (h”) 
for h->0 ;but P,, (A) — Q, (A) = By + 8) A+... + 8,h” isa polynomial 
of degree higher than 1; let 8; be the first of the numbers 8, 8,,..., 
8, other than zero; then we have: 
Pul(h)—Qny (A)=Buh® + Bugs het... + Ba h™=o0(h")=o(h*), 

since k <n; but this means that for k > 0 ) 

Crt + Baar APH. . .+8,h" 

Sager ae 
for h > 0, which is impossible for the limit of the left-hand side is 


evidently equal to; # 0 fork 0. This proves uniqueness of the 
‘solution of our problem. 


=PetPeh +... +Bah"-* > 0 


§ 39. The last term in Taylor’s formula 


Taylor’s formula gives us an expression o(k”) for the difference 
between the function /(@ + h) and the polynomial P,(A) (i.e. for the 
error in the approximate expression of f(a -+ f) in terms of a poly- 
nomial); we know that this describes the character of change of the 
difference f(a + h) — P,,(h) for h > 0, but it tells us nothing about 
the value of this difference, z.¢. for example, how small this difference 
is for a given value of hk. It is obvious that in definite calculations 
when we replace the expression f(a +h) by a polynomial Pp, (h), we 
need to know the magnitude of error caused by this substitution for 
the given values.of'a and # with which we are, in fact, dealing. We. 
must therefore try to find a method for the assessment of this error 
and not be satisfied by the mere indication of the character of this 
change given by Taylor’s formula. In other words: Taylor’s 
formula gives us only the characteristics of the limiting behaviour of 
€rror in question but we want to know how to assess this error for the 
given definite values of a and #. 
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With this view let us write formula (T) in the form 


Ha +h) = f(a) + Af (a) + SS) + 


fro -1 


+p Fe @ + Ral), 1) 


where we have assumed that 


Ry (h) = gs (a) + o(h aN, 


n! 
The term #, (A) is called the Jast term in Taylor’s formula. 


Let a denote an arbitrary (not necessarily integral) positive 
number. For the sake of brevity we denote a + h by b and consider 
the function 


et) =f) 4 6—a soy + OS soy 


wots C = ek Bie Vix) + hee (b — x)%, (2) 


We have so far assumed the existence of the function f™ (x) only 
for x = a; we shall now have to strengthen somewhat this assumption 
and assume that f/”) (x) exists for all interior points of the interval 
{a, b). Thisevidently means that in these circumstances the function 
o (x) will be differentiable at every interior point. On differentiating 
we find that (a <<. <b): 


2! (x) =Si (as) #6 — FG) — SS) 


—x nol 
oF mS = x)” pwr (x) — (b —x) f" (x%) +... + ua : ihe) 
- bait y+ pe age = 
— n—l R, 
= one f(x) — Pili g(b — x), 


Further, we evidently have 9 (4) = /(6), and it can readily be 
seen from (1) that 9 (a) = f(a + h) = f(d) also. Wecan therefore 
apply Rolle’s theorem to the function 9 (x) [in the interval (a, b) } 
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9’ (c)=0 ata point ¢ situated between a and 6 =a+h. We can 

evidently assume that ¢ = a + 0h, where 0 < @ < 1; then we have 
b—c=at+h—c=(l — OA, 

and we find that 


b — «jn! 


ot = RTA pty — Gea ale — a= 
= SO pt 5 (a + 0h) — ga) LO = 0, 
hence 
Ry(h) = OO ON rim (a + 8h). 


q{n — 1)! 


This expression for the last term in Taylor’s formula is very versatile 
owing to the presence of the parameter g which we can be given any 
arbitrary positive value. Evidently the problem as to which of these 
values gives R,, (4) the most convenient form depends on the form of 
the function f(x). However, in majority of cases itis most convenient 
to assume that g = nso that R, (hf) becomes 


Rall) = f(a + Oh 3) 
Formula (1) then becomes 
fla +h) =fla) + hf a) + = MAN le 3 
re 
(pays 


and represents a typical mean value theorem ; for n = 1 it becomes. 
Lagrange’s theorem 


fla +h) = fla) + hf’ (a + 6h), 


and it does, in fact, represent a generalisation of that theorem. The: 
form (3) for the last term in Taylor’s formula was also introduced by: 
Lagrange and is usually known by his name. 


a FO (a) + Sf (a + oh) (4) 


Among other forms of the last term in use let us note one more: 

form which can be obtained from the general formula when g = 1: 

an (1 — gy} 
(x — 1)! 





Ra (A) = fm (a + 6h) 


(this is known as Cauchy's form). 
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Having obtained one or other expression for the last term in 
‘Laylor’s formula we are now able to assess precisely the degree of 
accuracy given by this formula. In order to illustrate how this is 
done we shall now apply Taylor’s formula to some simple elementary 
functions. 


Example 1. f(x) = e7, a = 0; it is convenient to write x in- 
stead of h; formula (4) gives us f%* (0) = 1,4 = 1, 2, ... , since 
FYE) = 4, 

2 mal ar a 
x oii x xu x 


el i ee | + —_e¢ (O< 6 <1). 


"(a—Tt Tal 


When 0 < x < 1, say, then the last term of this formula does not 
exceed 


and, as n inereases, it decreases rapidly even for small values of x; in 
particular, when « = 1, we obtain the formula 
1 , 16 


Gi diel ah 


1 
ao al Nee ween fae 


which enables us to evaluate approximately the value ofthe number e 
with a high degree of accuracy, since the last term does not exceed 
ef{n! and, as we have said above, it decreases rapidly as n increases. 


Example 2. / (x) = sin x, a = Q; it can be readily seen that 
the numbers /f (0), f’ (0), /’ (0), ... form a periodical sequence 
0, 1,0, —1,0,1,0, — 1, ... Hence, formula (4) gives for a = 0,k = x 
and oddn =2k + 1, 

: xe ? 2 arkonl ? ae 
siny=x— a tar we t(—1)k (eat tt) (2e+1)! cos Ox, 
since f 2+) (x) =(—1)* cos x. A similar calculation for f (x)=cos x 
gives : 
sa 


Sh OR 
cose ag ea Opa 


2h—-2 


eee pa aes Xe 


In both expansions | cos 6x | < 1 and the last term whose absolute 
value does not exceed |x| ?#+1/ (2k + 1) ! or | x | ?* / (2k)! decreases: 
wery rapidly as & increases, particularly for small values of Pets 
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Example 3. f(x) = In x, a = 1; in this case 

fl) =a fl) = rf ) = (De — Ye, 

and therefore 

fM=$O/f' (I= Lf" 0) = — 1. £ ) = C1 "te DS 

so that formula (4) gives fora = l andkh =x: 


* 


x n—1 
In (1 + x) =e — B+ +(— 1)" 


x 
n—1 





+ 


$(—-)t a ten 


When 0 < x < 1, the absolute value of the last term is smaller than 
1 / n and therefore tends to zero when 7 increases, although not as. 
rapidly as in the previous examples. But when — 1 < x < Q, the 
factor (1 + @ x) ~” is infinitely large and we cannot judge the order 
of its growth, for @ is unknown. In this case Cauchy’s form for the 
last term is more convenient 


an (1 _ 6) nl “nr 1—é@ n—1 
Ris) a rs pa 
Qa 2 ay eee) 3 
when — 1 < x < 0, we have 0 < (1 — 6)/(1+ 6 x) <1; the absolute 
value of the last term is smaller than | x |"/(1 — | x |) and tends to. 


zero for 2 —> ©. 


In accordance with the problem stated at the beginning of this 
paragraph we were. trying to assess the quantity R, (A) for the given 
values of a,.h and n, i.e. we were trying to assess the magnitude of 
the error caused by replacing f(a+h) by a polynomial of the nth 
degree. In practice, we often have to solve problems which are in a 
sense, opposed to the above problems ; thus the permissible limit of 
error A is often given at the start ; the problem usually involves two. 
questions : either — within what limits of variation of A can we gua- 
rantee, for a given n, that | R, (A) | will not exceed A or, conversely, 
how lagre should the number z be taken for the given limits of varia- 
tion of # so as to achieve this aim. We will show below how such 
problems can be solved on the basis of the most widely used form (3): 
for the last term. 


‘Let us. assume ‘that we are interested in the values of the 
function f(x) in interval (aQ—Il <x <a+ 1). If we denote by 
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M™) the maximum value of the function | f (x) | in that interval, 
then as a result of (3) we have | Ry (h) | <M™ |h[" / 2! for |Al<1; 
hence in order to guarantee the required assessment | Ry (4}| < A 
it is sufficient that : 

MO | pin 


n!} 7 


or 


ee (*) 


Hence if| | is smaller than the smallest of the numbers / and 
(An! | M™)1/", then the inequality | ,(h)| <A canbe guaranteed. 
If the limit of the error A and the number / which determines the 
amplitude of variation are given for the given calculation, as it 
frequently happens, then we must take n sufficiently large so that 


Ant) 2+ 
jaa fe au 


In that case, the inequality (*) will be satisfied for |h| < 1 and hence 
also the required inequality | Ry (h)| < A. 


If, for example, f(x) = sin x or f(x) = cos x, cf. the above 
example 2, then it is very easy and natural to assume in calculations 
that a = 0,/ = w/ 4, for by knowing the values of sin « and cos x 
in the interval (0, 7/4) we can find without further calculations the 
‘values of these functions for every «. Since | f'4+) (xg) | = 
[cos Ox | <1 for f(x) = sin x, therefore we can assume that 
M(2h+1) = 1. Let the required degree of accuracy be A = 0:0001. 
We should then have : 


2):4+1 
0.0001 : (2k + 1)! > (+) ; 


which, as can readily be calculated, happens when & > 3. Hence 
the approximate formula 


3 5 


: x x 
sn x Sx — 31 4. ra 

gives the value of the function sin x in the interval | x / < w/4 with 
an error not exceeding 0°0001. The calculation is similar for 


f(x) = cos x. 


CHAPTER XN 


APPLICATION OF DIFFERENTIAL CALCULUS 
TO ANALYSIS OF FUNCTIONS 


§ 40. Increasing and decseasing functions 


The true meaning of a derivative which leads us to its general 
definition implies that the absolute value | y’ | = | f* (x) | ofthederi- 
vative determines the rate of change of the function y = f (x) in 
relation to the independent variable x ; hence by knowing the deriva- 
tive of the given function we can, in the majority of cases, directly 
find the rate of change of the function in a given interval. In order 
to appreciate significance of this information let us consider, the follow- 
ing example. Both functions y = x* and zg = In x inerease together 
with x.for « > 0. ‘To find the rate of this increase consider their 
derivatives 


, 


1 
yl = 2x, z Tae 


we can see that as x increases, y’ increases continuously while 2’ de- 
creases continuously ; this means that as x increases, the function 
y = x" increases at an increasing rate while the rate of increase of 
the function z=In x decreases ; thus although both functions increase 
as x increases, their respective rates of increase show the above diffe- 
rences; we are able to detect these differences by simply looking at 
their derivatives »’ and z’.\ This difference in their behaviour can. 
also be readily detected by looking at the graphs of these functions 
(Fig. 20), but it is one of the advantages of the derivative that it does 
not necessitate construction of a graph for the given function in order 
to ‘find its rate of change. 


On the other hand we have already seen that the sign of the 
derivative determines the direction of the change of the function : a posie 
tive derivative implies increase and a negative derivative decrease of 
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a function (both are related to the increase of the independent varia- 
ble). We must now state this problem more precisely. 


Let us agree to say that the function _y = / (x) defined in the 
interval (a, 5) is non-decreasing in that interval if we always have 
S (x2) > f(x) for ax, <an <b 
(t.e. if in that interval » cannot 
decrease as x increases) ; if, how- 
ever, the exact inequality / (x.)> 
> f(xy) holds fora <x, <x <b, 
then we shall call the function 
y =f (x) an inereasing function 
in the interval (a, 4). Similarly, 
ifthe signs of the inequalities for Fig. 20 
F(x;) and f(x) are interchanged, 
they are defined as non-increasing and decreasing functions, respectively, 
in that interval. It is obvious that every increasing function is also 
non-decreasing, but the converse is not true ; similarly every decreas- 
ing function is also non-increasing, but the converse is not true. 





The relationship between the sign of the derivative and the 
direction of change of the function is expressed by the following pro- 
positions. 


Theorem 1. Jn order that the function f(x), differentiable at every point 
in the interval (a,b), should be non-decreasing in that interval, it is necessary 
and sufficient that 


f(x) 20 (agx <4). 


Proof. 1) If the function f(x) is non-decreasing in (a, 6) for 
@asix<x+th <4), then : 


f(x Fh) = f(x) >, 
and therefore also 


f(x ee >0; 


it follows from corollary 2, theorem 2 § 10 that we also have 
f(x) = lim FO! Da Le) *) 50, 
h—->0 


2) If f’ (x) > O(a <x < 4), then it follows from the theorem 
on finite increments that fora <x, <x, <0 


I (x2) — f (x1) =f" (6) (x2 — x1) 20 
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(here ¢ is a point between x, and x4, and hence also between a and 
5). But this means that the function f(x) is non-decreasing in the 
interval (a, 6). Theorem 1 is thus proved. 


Theorem 1 evidently remains valid when the word ‘“non- 
decreasing”’ is replaced by “non-increasing’”’ and instead of writing 
S' (x) > 0 we write f’ (x) <0. To prove this, it is sufficient to apply 
the statement of theorem | to the function — f(x). 


Theorem 2. Jf f’(x) > 6 (a <x <5), then the function f(x) 
increases in the interval (a, b). 


Proof. The theorem on finite increments gives us fora < +, 


<xe. <b 
ST (x2) — f (xi) = Sf (6) (x2 — x1) > 9, 
since x; <¢ < x, and therefore also a < ¢ < 4, hence f' (¢) > 0. 


The property f’ (x) > 0 (a <x < Bb) is therefore sufficient in 
order that the function /(«) should increase in the interval (a, 2), but 
it is not.the necessary condition ; the converse of theorem 2 is incorrect ; 
SF (¥2) > fle) (a <x, < _ <4) implies (as a result of theorem 1) 
only that f’ (x) > 0 (@ <x <5) but not that f’ (x) > 0 (a@<x <8); 
this is illustrated by the function f (x) = x°, which increases on the 
whole number line (— co < x < + 00) whereas f’ (x) = 3x? = 0 
for x = 0; Fig. 21 clearly illustrates this phenomenon; the curve 
y = x* increases continuously from left to right and at the same time 
has a horizontal tangent at x = 0. 


It is self-evident that we always have f’ (x) <Ofora<x <b 
and the function f(x) decreases in the interval (a, 0); the converse 
statement is, in this case, not true. 


Example 1. Thefunction y=x*?—6x?+9.x +42 has the derivative 
yp’ = 3x? + 12x +9 = 3 (x — 1) (x — 3); 


the brackets (x — 1) and (x — 3) have opposite signs for 1 < x < 3 
and have the same sign for x < 1 and x > 3; therefore 


vy >O(e<lorx > 3)andy’ <O'(1 <x < 3); 


the fiinction y iricreases for x < 1 and x > 3 and decreases for 
1<x< 3. A simple calculation gives us: 


y=6 (e=1) y=? &« =3), 
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and, on the other hand, it is evident that 
yor © (4x > — 0), yorto(x—> 4+ ow), 


therefore the sample graph of the function y can be fairly drawn on 
the basis of this short analysis (Fig. 22). 


Example 2. The function y = ¢* — x — | has the derivative 
Soe as 1, 


so that y’ > Oforx > 0 and y’ <0 for x <0. The function y 
increases for x > 0 and decreases for « < 0; it is equal to zero for 
x = 0 and therefore it must be positive for all other values of x; this 
proves the important inequality 


e* >1l+x, 


which holds for every real x, but the sign of quality holds only for 
x = 0, 





Fig. 21. Fig. 22. 


For other useful exercises ¢ f. problem book by B.P. Demidovich, 
§ II, Nos. 320-325, 332, 339. 


§ 41. Exterma 


Let » = f(x) be a function differentiable at every point in the 
interval (a, b). We know that this function is continuous in that 
interval and (theorem 2 § 23) attains its maximum and minimum 
values in that interval. In view of practical applications it would be 
interesting to know, for what values of the independent variable the 
function takes its maximum (or minimum) values. Thus y =f (x) 
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can measure efficiency of a plant which depends on the choice of x, a 
choice which can be arbitrary within the limits (a, 6). In such cases 
we would evidently choose an x in that interval such that y assumes 
its maximum values (and, of course, we shall also be interested in 
this maximum value). We shall now learn to appreciate significanee: 
of methods of differential calculus in such cases. 


The greatest value of the function »y = f(x) in the interval 

(a, 6) is called its maximum and the lowest value minimum; when we 
want tosay ‘‘maximum or minimum”, 

cs) we say more briefly “extrema’’ or 
a “extreme values” (i.e. border values). 
i y) , _ If we speak of extrema of the function 

' ; 1 in the whole interval (a, 6), we speak of 

fn Cu the “‘absolute’’ extremes (maximum 

i | or minimum) of the function. The 
@ce b concept of local extreme (as applied to: 
Fig. 23. a given spot) implies as follows: the 

function f(*) has a local maximum at 

the point ¢ (a <¢ < 6) if its value at the point c is greatest in com- 


parison to its values at all points sufficiently close to c, 7.e. if a number 
8 exists such that 


Sloth) <f (6) 


for all A, for which | h| <8. The local minimum is defined similarly. 
As a result of the condition @ < c¢ < 6 the local extremum is only 
defined for inter?or points in the interval (a, 5). 


Fig. 23 shows the difference between the absolute and local 
extrema: the function y = f(x) represented in this graph has its 
local maximum at the point ¢ which, however, is not its absolute 


maximum, for at a certain distance from the point c the function 
assumes a greater value than /(c). 


It is obvious that if the function assumes its greatest value at an 


interior point ¢ in the interval (a, 6), then the absolute maximum 
will also be its local maximum. 


Hence in order to find the absolute maximum (or minimum) of 
the given function in the given interval we must proceed as follows: 


1) find the local maximum (or minimum) of the function inthe 
given interval ; 
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2) add to the values of the function at points of its local. 
maximum (or minimum) its values at the ends of the givcn interval. 
and choose from al{ these values the greatest (smallest) value *). 


The second problem presents no difficulties if, as is usually the- 
case in practical problems, the function has only a finite (and usually 
small) number of extrema. Thus the difficulty is concentrated in the- 
first problem which we can now solve with the halp of methods of” 
differential calculus (provided the function is differentiable). 


Let the function y = f (x) have a local maximum at an interior: 
point x = c in the interval (a, 5) and let it be differentiable at that 
point. On the basis of the lemma in § 36 we can therefore maintain 
that f’ (c) = 0; we evidently also arrive at the same conclusion 
when f (x) has a local minimum at the point c. Thus if the function 
J (x) is differentiable at every point in the interval (a, 4), then all its. 


local extrema, if they exist, will be found among the roots of the- 
equation 


f(x) = 0. (1) 
We must thercfore begin the solution of our problem by finding allf. 
roots of this equation between a and b. The roots of the equation (1). 
are usually called stationary points of the function f(x); this term is. 
quite intelligible : the rate of change of the function f{ (x) at such 
points is equal to zero ; as x passes through sucha point, f(x) changes. 
very slowly and its value is particularly stable. 


We must therefore find all stationary points of the function / (x)- 
in the interval (a, 6) and all the required local extrema will then be- 
found among those points. Let « be one such stationary point ; we- 
must find out whether it gives a local extremum and, if so, the type- 
of this extremum, 7¢. a maximum or a minimum. Let us now- 
assume that the function / (x) has a derivative of the first order and: 
several more derivatives of higher orders at the point «; let usassume- 
that in general 


Slo f eS Se Ee) 0, 
but f™ («) AO (iff (#) 40, then n = 2). In this case we evi-- 
dently obtain from Taylor’s formula (T) § 38 : 


n) 
jn fie) 


fle +) —f@) = he) + 0 (0), 


*) Ifthe function has no derivatives at certain points in given interval, then. 
all such points must we added to the ends of the interval, The reader should. 
consider the example v =|x|( —- 1<*< 1). 
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and in order to solve our problem we must analyse the sign of the 
difference f (2 + h) — f («) for sufficiently small values of [#|. Since 
the second term on the right-hand side of the last equation is infinitely 
small as compared to the first term for 4 > 0, the sign of the whole 
right-hand (and also left-hand) side of this equation will, for suffi- 
ciently small values of || coincide with the sign of its first term which 
we must therefore analyse. 


If is an even number, then h” > 0 and the sign of the expres- 
sions h” f™ (a) / 2! coincides with the sign of f ™ («) (this also 
means that it is independent of h) ; if f  («) > 0, then we have for a 
sufficiently small | A | ; : 


J(% +h) —f(«) > 0, 


ie. the function f(x) has its minimum at the point « ; on the other 


hand if f™ (x) <0, then for all sufficiently small values of |A| we 
have : 


St (a +h) — f(«) > 0, 


z.€. the function f (x) has its maximum at the point «, 


If'n isodd, then ”, and therefore also the expression /” f(a) [nt 
changes its sign when the sign of & changes and therefore, provided 
|4| is sufficiently small, the difference f(x + hk) — f(a) will have 
one sign for positive h and the opposite sign for negative h; this evi- 
dently means that the function f (x) can neither have a maximum 
nor a minimum at the point « (an example of this kind is given by 
S (s) = x8 for x =0: f' (0) = f’” (0) = 0, f” (0) 0 (of. Fig. 21 40, 
where the point x = 0 gives a typical example of a stationary point 
without a local extremum). 


We thus obtain (on the assumption that the function f (x) can 
be differentiated a sufficient number of times) a fully defined method 
for the analysis of the character of every stationary point«: Let 
among a sequence of derivatives f' (a) , f’’ (a), ... the derivative f ™ (a) be 
ihe first which is not equal to zero; then 1) ifn is odd, Junction f (x) has 
neither a maximum nor a minimum at the point « ; 2) if nis even, a local 


extremum exists at the point o which will be the local minimum for f™ (a)>0 
and the local meximum for f ™ (a) < 0. 


In particular, we have a local minimum for {’ («)=0, f” (x) <0 


and a local maximum for f'(«) = 0, f” («) < 0 we must analyse the 
‘derivatives of higher orders for f’ (a) = f” («) = 0. 
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The above method for the analysis of stationary points may be 
inapplicable only when the function f (x) has no derivatives of suffi- 
ciently high orders at the point « or when its derivatives of all orders 
are equal to zero. It is interesting to note that the latter case may, 
in fact, take place (and we do, of course, exclude the trivial case when 

_/ (x) is simply a constant in a certain neighbourhood of «). The 
function 


Paar + 0) 


has a stationary point for x = 0, where 


BS a yh ah ee Oy 
whereas the behaviour of this function is very simple in the neigh- 
bourhood of the point + = 0 (¢f. Fig. 24) and it differs very little 
from the behaviour of functions like y = x? or y = x‘; a difference 
‘in the behaviour of these functions can be detected only at a certain 
distance from x = 0. 


The established method of analysis of stationary points is 
‘significant froma theoretical point of view which for its finality is, 
in practice, often replaced by simpler methods which are also more 
convenient insofar as they do not necessitate existence of derivatives 
of higher orders. If« is the stationary point of the function / (x), 
ne. if f’(%) = 0, then in order to determine the character of this 
point it is sufficient in many cases to determine only the sign of the 
derivative f’ (x) in the immediate neighbourhood of the point « ; thus 
we always have f{’(x) <0 for x < « (provided | x — «@ | is sufficiently 
small) and we have f’(x) < 0 for x < « (and | x — « | sufficiently 
small) ; hence the function f (x) decreases an the left of # and increases 
-on the right of « : therefore at the point « it has its local minimum ; 


Yh 





a 
Fig. 24. 


when the signs of {’(x) are reversed, we obtain the local maximum ; 
when f’ (x) maintains the same sign for all values of x sufficiently 
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close to «, then, as x passes through «, the function f(x) either conti-- 
nues to increase or decrease “but in neither case it can have a local: 
extremum at the point a. 


In spite of the simplicity of this method it must not be over- 
rated. The determination of the sign of f’(x) for all values of x: 
sufficiently close tos is in many cases not easier but more difficult 
than the evaluation of several derivatives at the point «. Moreover, 
this method can only give results if, for example, /’(x) has on the- 
right of « one and the same sign for all values of x sufficiently close- 
to a; this may, of course, not be so; it may happen, for example, 
that as x > « + 0, the derivative /’ (x) changes its sign an infinite- 
number of times; if this is the case, the method described above is 
inapplicable in principle. 


Example 1. Find the absolute maximum and the absolute~ 
minimum of the function 


f(x) = x8 — 6x? + 9x 42 


in the interval (0, 4). While investigating this function in §40 we: 
have found that it has two stationary points: « = 1 and x = 3; the 
first of these gives the local maximum and the second the local. 
minimum. On adding to them the ends of the given line, we find 
that the following points can only be absolute extrema for f(x) : 
0,1,3 and 4. We have 


J(0) = 2, f(l) = 6 f(3) = 2, f(4) = 6; 


hence the function {(x) has two absolute maxima (for x = | and. 
x = 4) and two absolute minima (for x = 0 and x = 3) in the: 
interval f0, 4). ; 


Example 2. Find all local extrema of the function 


: Cee 
f(x) = sinh x — x= cae a 
. et e7~= 
f' (x) = cosh x — 1 =p =“) 
and we can immediately see that x = 0 is a stationary point. 


{/’ (0) = 0]; further 


f(s) = sinha, (0) = 0, 
tS’ (x) =coshx, f'’(0) = 1; 
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‘hence the first non-vanishing derivative is of an odd (third) order 
‘and therefore the function / (x) has no local extremum at the station- 
ary point x = 0. It remains to be shown that no other stationary 


points exist. We can directly see from the expression obtained for 
Sf’ (x) that 


tre. <oO(% < 9), 
fs) > O0(x > 0), 


and therefore /’ (x) decreases for x < 0 and increases for x > 0; 
since f’ (x) = 0, therefore f’ (x) > 0 for all x 4 0, 7.¢. apart from 
the point x = 0 the function f (x) has no other stationary points (the 
graph of this function is similar to the graph of the function y = *°, 
ef. Fig. 21 $40). Hence the function f (x; has no local extrema. 





Fig. 25. Fig. 26. 


Example 3. From a rectangular section ofa tin sheet 2a wide, 
strips of width x are bent on each side (Fig. 25) so as to make (an 
open from the top) trough whose cross-section is shown in Fig. 26. 
How wide should be the bent sides + so that the trough obtained 
‘should have maximum capacity ? 


It is evident that the length of the trough is not involved in the 
‘solution of this problem ; the capacity of the trough is proportional 
to its cross-sectional area which is equal to 2x (2 — x). We must 
therefore find the absolute maximum of the function 


f(x) = ax — 2x? 


in the interval (0, a). We have: 
St’ (x) = 2a — 4s, 
and the only stationary point is x = a/2; since f" (x) = —4<0 


(for every x and, in particular, for x = a/2), f(x) has a local 
maximum for x = 4/2: 


ge $e 
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This will also be the absolute maximum, since f (0) = f(a) = 0.. 
Hence it is most convenient to bend the edges so that their width 
should comprise of one quarter of the width of the given strip. 


Further exercises can be found in any problem book on mathe- 
matical analysis. We can recommend exercises in B.P. Demidovich’s- 
Problem Book Section II, Nos. 436-444, 448, 452-466, 468-472, 539,. 
541, 542, 546, 552, 558. 


CHAPTER NI 
INVERSE OF DIFFERENTIATION 


§ 42. Concept of primitives 


If the law of motion of a body is given by an equation of 
the type 
s=f(i), 


where ¢ is time ands is distance travelled by the body, then by 
differentiting the function f(t) we can find the instantaneons. 
velocity 
v= f' (2) 

of this motion at the given instant. However, the converse problem. 
is more frequently met in mechanics: we are given velocity v = v (t) at 
a moment of time ¢ and weare required to find the law of motion of the: 
body, i.e. the relationship between the distance travelled and time 
taken by the body. How can we solve this problem ? We know that: 
the instantaneOns velocity v= v (/) is a derivative of the function 
s=f(t) which expresses the required law of motion of the body. 
Thus the derivative /’ (¢) = v(t) of an unknown function f(t) is given 
and we must find this function. This problem is evidently inverse of 
the fundamental problem of differential calculus: there we had to- 
find the derivative of a given function whereas here we must find the 
initial function from its given derivative. 

We are given, for example, that at the instant ¢ the velocity of. 


a moving body is equal to 
v= al, 


where a is a constant. How can we find the law of motion ? To solve- 
this problem we must fiind a function whose derivative coincides with. 
at. We know one such function 
‘ at® 


a 
175 
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Can we therefore say that the required Jaw of motion will be 


at® 
s=—? 


2 


a 


‘This would evidently be premature, for apart from the function aé?/2 
-other functions may exist whose derivatives are also equal to at; and 
if this is so and we have no other information, wecannot say which of 
‘these functions will give the required law of motion, It can readily be 
-seen that other functions of this type exist : the function 


at? 


saat é, ; (1) 


~where 6 is an arbitrary constant, gives a derivative af; we thus obtain 
.a whole family of functions each of which can express equally the 
required law of motion. At the same time we do not even know 
whether the family (1) contains all functions which have the given 
-derivative at, for other functions 1ay exist outside the family (1). 


The above problem can readily be generalised. As we know, 
the derivative f’ (x) of the given function f(x) always expresses the 
rate of change of this function (in relation to the independent vari- 
-able x). In many problems we are required to find a function whose 
‘rate of change (in relation to x) is given for every x. From mathe- 
‘matical point of view this type of problem always involves finding 
the unknow function from its given derivative, i.e. it is inverse of the 
‘fundamental problem of differential calculus. Let us now state this 
problem in its most general form; to do so, we shall introduce the 
mecessary terminology and examine possibilities of finding a solution. 


Thus we are given a function f(*) in a segment (or on the 
‘whole uumber line); it is necessary to find the whole set of such 
functions (x) for which we have at every point on the given segment: 


F'(x) =f (x). 
We shall call such a function a primitive of the function f(x) so that 


‘the concept of a derivative and a primitive are reciprocal *). 


We cannot evidently forecast whether the given function f(x) 
‘has primitives and, if it has, then how many, and how they are inter- 
‘dependent. However, wecan establish certain facts in this connection 


*) A primitive is also known as an indefinite integral of the given function; we 
are, however, not going to use that term. 
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from elementary considerations: to begin with, if F(x) is one of the 
primitives of the given function f(x), then every function of the family 


F(x} + C, (2) 


where C is an arbitrary constant, will evidently also be a primitive 
of the function f (x). Let us now show that no primitive of the 
function f(x) exists outside the family (2). In fact, let 9(x) be an 
arbitrary primitive of the function f (x); we can find the difference 
2(x) — F (x); since the derivative of this difference is evidently equal 
to zero for every x, it follows from the last theorem in § 36 that 
¢(x) — F (x) is a constant which we can denote by a. Hence 


? (x) = F(x) + 4, 


i.e, every primitive 9 (x) of the function / (x) belongs to the family (2). 
We thus deduce the following important result : 


Theorem. Jf the function f (x) has a primitive F (x), then 1t has an 
infinite number of primitives, all of which belong to the family (2). 


The importance of this result is self-evident: it shows that in 
order to find all primitives of the function f (x) it is sufficient to find 
any one of them ; if we succeed in finding one such primitive, then 
every other primitive is obtained from it by adding a constant. 
Hence the problem we tried to solve is simplified : we must find out 
whether the function f (x) has at least one primitive and if so, we 
must find this primitive. 


Finding primitive of the given function is known as integration 
of this function. We can say that integration involves transition 
from the derivative of a function to the function itself. Ifwe regard 
this transition as an operation, we can say that integration is inverse 
of differentiation : if the given function is first differentiated and 
then integrated, then, by choosing a suitable constant C, we obtain 
the initial function by means of formula (2). 


Let us now recall that we have agreed to understand by the 
term differentiation the finding of both the derivatives of the given 
function and its differential. The inverse operation, vz. integration, 
can therefore involve finding the function from its derivative as well as 
from its differential. The differential dF (x) of the required function 
is equal to F’ (x) dx; therefore finding the derivative or the differen- 
tial is one and the same thing. 
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We obtain a'primitive as a result of integration. Hence every 
differentiable function F (x) is primitive of its derivative /’’ (x) or of 
its differential dF (x) = f°’ (x) dv. 


Integration is denoted bby the symbol {. Finding a primitive 
(integration) is an operation inverse of finding the differential 
(differentiation) which we denote by the symbol ¢d. Hence the 
symbols d and f express two inverse operations. If we subject the 
given function F (x) to the operation d and then perform the opera- 
tion J, then, by choosing a suitable constant term, we return to the 
initial function F (x) :, 


§ dF (x) = F(x), 

or, since dF (x) = F'(x) de, 
{ F' (a) de = F (x). 

If F’ (x) =f (x), then 
F(x) = JQ) a; 


hence it can be seen from this formula that the function FP (x) is. 
primitive of the function f (x). By the way it is accepted to under- 
stand by the expression 


ff (x) dx 


not a particular primitive but the whole family of primitives of the 
function f (x); if F (x) is one such primitive, then it is written as 


SSG) dx = F(x) + GC, (3) 
where C denotes an arbitrary constant, 7.e. the so-called constant of 


“integration”. ‘It is evident that'in view of its definition the equa- 
- tion (3) is equivalent to the equation 


B(x) = f (x). 


The function /(x) on the left-hand side of the equation (3) is: 
_ known as the “integrand” and the product f (x) dx as the “integrand. 
expression”. | 


Example 1. = Since d (x *) = 3x? dx, so 


(Se 2de Set CG. 
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: dx 
Example 2. Since d tan x = ——;—, so 
cos? x 
dx 
—+4,— =tanx+C 
co.” x + 


and so on. 


It can be readily seen from these examples that a formula of 
the derivative (or differential) of an arbitrary function also gives us 
an integration formula only by reading it, as it were, from right to 
left. Keeping this in mind while looking at the table of derivatives 
of simple functions given at the end of § 29 wecan draw the following 
conclusions : 


1, f 0. dx = C (the primitive of zero is equal to an arbitrary 
constant). 


2. f§1.dx =x + C, and in general 
‘ fadx=ax4+G, 
where a is a constant. 


3. Forevery « 4 — landx > 0 
etl ; C 
Baa _ Ri 
| x” ile rea + C, 
and at the same time (if x > 0) 
[actae= [SF = inxt C. 
The following remark must be added to this statement. Owing 
to the fact that the function In’( — x) has the derivate 1/x for x < 0, 
we have 
{= =In(—»)+C 
for x < 0; hence we have the general formula 
[¢ =Injxl[+C 
x 


for x > Oand* < 0. 
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4, [ede aer +e, 


and for every positive a 4 1 





a* C 
[« ax = ine + °C. 


5. For ‘the polynomial P (x) = ax” + aya"! + ... + aa we 
have 


Ggxtt ay x” 


; | P (x) dx = ae iv ——— +... fatx t+ C, 


n 





so that the primitive of a polynomial is always a polynomial one 
degree higher than the given polynomial. 


6. [sin xde= — cos + ©, 


| cos «dx = sinw + C, 








’ 
Be =tana+ C, 
cos? x 
|4e- —cotxr 4+ C, 
dx , 
ie lv , = aresin x + C= — arccosx + C, 
—-x 
dx 
[rss == arctan x + C = — arccot x + C. 
$8. | sinh xdx = cosh x + C, 


| cosh x dx = sinh x + C. 


All these formulae can be’ verified by the same method: it is 
sufficient to show that the derivative of the right-hand side is equal 
to the integrand on the left-hand side ; this follows in all cases from 
the corresponding formulae in the table of derivatives at the end of 


§ 29. . 
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We have thus learnt to find primitives of a series of simple 
functions. However, our knowledge in this direction is still very 
limited: we have only learnt to integrate functions which happen to 
be on the right-hand sides of differentiation formulae collected in that 
table. But these functions do not even include all simple elementary 
functions ; they do not include functions like In x, arctan x and many 
other functions; and we have so far not met a function whose 
derivative is equal to In x or arctan x; therefore we are not only 
unable to find the primitives 


| Inx dx or | arctan x dx 


but also do not know whether they exist. 


Integration is much more complicated and difficult than 
differentiation. This is first of all due to its nature. Finding a 
derivative of a given function is facilitated by the fact that’ the 
definition of differentiation itself has a “constructive” character; a 
derivative is simply defined as 


tim J +4) ger A 
h-0O 





i.e. as a series of defiite operations which must be performed over the 
given functions; for example, having been asked to find the deriva- 
tive of the function sin « we know in all details how to proceed in 
order to obtain a result; while trying to find a primitive, we are 
confronted with a totally different problem; we have no constructive 
element and we are given no method which would tell us how to find 
the primitive, or even how to begin. For example, when we are 
asked to find 
| In x dx 


and we do not find In x among the right-hand sides of the formulae 
in our table, we are unable to tackle the given problem and find its 
solution. 


This position is further complicated by the fact that we do not 
even have a sequence of laws for integration which, in the case o. 
differentiation, enable us to use the laws of dfferentiation of several 
functions in order to find derivatives of their various combinations, 
e.g. their sums, products, composite functions, etc. ‘There are very 
few such rules available in the theory of integration and their 


182: A COURSE OF MATHEMATICAL ANALYSIS 


application is rather restricted. Nevertheless, the significance of these 
general methods of integration is very great, for they do eventually 
enable us to integratea fairly large number of most general functions. 
In the following paragraph we shall consider several simple methods. 
It must also be stressed that in contrast to the general methods of 
differentiation which are used almost mechanically, the application 
of. general methods of integration requires great skill—in every case 
one must learn to select the most suitable method and use it in the 
most convenient form. This skill can only be acquired after long 
practice. 


The reader will find a large number of examples in Section II 
of the Problem Book by B.P. Demidovich. 


The science which deals with integration of functions and 
properties of primitives is known as integral calculus and, together with 
differential calculus, comprises one of the most important branches of 
mathematical analysis. 


§ 43. Simple general methods of integration 


Lf y = ty + tte 1... + uy ts an algebraic sum of n functions of x 
and if J ux dx extsts for allk (l <k <n), then § y dx also exists and 


[oe= [ues [x ax enc + | Un aX. (1) 


This rule is often formulated in short as follows : ‘‘primitive of 
an algebraic sum is equal to the algebraic sum of primitives”. To 
prove this it issufficient to show that derivative of the right-hand side 
of the equation (1) exists and is equal to y; but this follows from the 
law of differentiation of an algebraic sum (law 3° § 29). 


2. If u is a function of x and a is a constant and if § udx exists, 
then § au dx also exists and 


| audx = a| u dx. (2) 


In short: “a constant factor can be taken outside the sign of integra- 
tion”. ‘To prove this it is sufficient to differentiate the right-hand 
side and use the theorem which states that a constant factor can be 
taken outside the symbol of differentiation. 


In the two cases considered so far we find that the correspon- 
ding laws of differentiation can be fully used in aninverseform. But 
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‘as we shall now see, there are only these two cases; all other laws are 
‘only partially convertible and result in integration laws which can 
sometimes be very useful but not applicable in all cases. 


We must finally note that we have omitted constants of integra- 
tion on the right-hand sides in the relation (1).and (2); it is not 
necessary, for in both cases the symbol of the primitive stands on the 
right-hand side (or several such symbols) ; according to our agree- 
ment this symbol] embraces the whole family of primitives and thus 
contains, as it were, an invisible arbitrary constant. This note also 
applies to a series of subsequent formulae. 


3. Integration by parts. Let us now see what we obtain as a 
result of inversing the formula 


(uv) = we! + au’, 


which expresses the law of differentiation of a product of two func- 
tions. Integrating the above equation we have : 


| (uo) ’ dv = wv = | (uv' + vu’) dx; 
applying the rule (1) to the right-hand side we obtain : 
uy = | uv’ dx + | vie’ dx. 


This formula contains two primitives ; therefore by using this formula 
we are unable to find both primitives and we can only express either 
of them in terms of the other, for example 


{ uw’ dx = uw — | wu! dx (3) 


‘What does this formula give us? If the functions u andv are known, 
we can express the primitive f wi‘ dx in terms of the known function 
uv and another primitive J vw’ dx, which has the same structure as 
the initial primitive. However, in relation to the form of the func- 
tions x and z one of these primitives may appear simpler than the 
other ; if, for example, the second primitive (on the right-hand side) 
is simpler than the first, then formula (3) is undoubtedly useful, for 
we can replace the given primitive by another primitive of simpler 
form. It may sometimes happen that the primitive on the right-hand 
side belongs to the elementary table in § 29 or may be known on the 
basis of some preliminary considerations : in such cases the formala 
enables us to obtain the primive f w ‘ dx in final form. 
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The significance of formula (3) and specific characteristics of its 
application can best be shown by definite examples. This formula 
is known as the formula of integration by parts *). 


Example 1. We have already said that J In x dx is not known to 
us, for we do not know a function whose derivative is equal to In x. 
By using the formula for integration by parts we can readily find this 
primitive. In order to use the formula (3) the integrand must be 
represented in the form of a product of two functions, the first of 
which stands in place of u and the second in place of v’.. This can be 
done in an infinite number of ways and we must learn to select one 
such method which would represent the primitive f ow’ dx on the 
righthand side of formula (3) in the simplest possible form. But how 
can this be foreseen ? Let us recall that the derivative of In x which 
is equal to 1/~ is a much simpler function than the function In x itself 
and since in the transition from the primitive f{ w’ dx to the primitive 
§ vu" dx the function uw is replaced by its derivative wu’, we can consi- 
derably simplify our problem if we’‘assume that 7 = In x. But it 
follows from wv’ = In x and u = Inw that v’ = 1, therefore we must 
choose in place of v a function whose derivative is identically equal to 
unity ; it is, of course, simplest to assume that v = x ; hence 


1 

w= inw, u’ = —-, 
x 
v' =i, v= 4A, 
w' =Inx, cul = 1, 


and formula (3) gives : 
fins dv = ins —[l.de=xins— x4 Cc. 


We can therefore see that in this case formula (3) enables us to obtain 
the solution in its final form. It is usually advisable to test the 
correctness of this solution and sec that the derivative of the function 
obtained is, in fact, equal to In x. 

*) Yn its general form this formula does not give a final expression for the 
paimitive Sw’ dx but simply gives the answer in terms of another simpler primitive; 
it only partially solves the problem of integrating the product uv’ by simplifying it. 
Hence the term “‘partial integration” has been used in many European countries ; 


the term “integration by parts‘* which is established in many other languages as 
well as also in our own, is much less expressive. 
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By using similar considerations and the formula for integration: 
by parts we can also find primitive of a more general form 


| a® In wv dx, 
where «@ is an arbitrary constant; if« ~ — 1 we can assume that 
1 
=> Tax u’ == —, 
x 
4g 1 
, 
v= x ar 
a+ 1’ 
, x 
uv’ = x*Inx, w= —, 
a+ | 


and formula (3) gives : 


.ael 
[x*tnxds = ee (In — ie ) + ¢C. 


i +1 
When « = — 1, we have: 
; I 
u = In x, uo == -—, 
“ 
] 1 
pia —, vy = In x, 


and formula (3) gives : 


In x 4, = In? *«— [2 ax. 
x x 


in this case the primitive on the right-hand side appears to coincide 
with the primitive we are trying to find. Nevertheless, the obtained 
relation solves our problem and we get : 


2 (* © ds: = In? BT 
x 
and therefore 


Le = Lage + C, 
a 2 


Example 2. Let us assume that we want to find the primitive 


[x dx. 
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‘One of the two factors of the integrand remains uncharged by diffe- 
rentiation while the other gives 1, i.e. a simpler expression than the 
function itself; therefore we can assume that u = x and v’ = e*; we 
thus obtain : 


, 
iv Xs, “u’e=1l, 
v’ = e%, ee ee 
wl E ' — of 
uo’ = xe*, pu’ = e*, 


and applying formula (3) we obtain : 
[= dx = xe*® — fe dx = xe* —e* + C, 


.and our problem is finally solved. 


Let us now assume that we want to find the primitive f x7 e7dx; 
using the same arguments as above we assume : 


=a: a 
x, wu’ = 2x, 

fa 
vp =e*, v= et, 
uv’ = x%e%, = wu’ = 2xe*, 


and formula (3) gives : 
J xte* dx = xter — 2 | xe* dx; 


‘since the primitive on the right-hand side is the same as the one we 
found above, we also succeeded in finding the primitive J x? e* dx. 
In general, if we want to find the primitive 


Ye (x) = [ ener a 


where n is an arbitrary natural number, we assume that 


Can", uw’ = nx}, 
) 
vy = e%, v =e", 
ie ae, ae SS a, 


and formula (3) gives: 
vn (x) = ee" — | athe? dees ete? = al 54 (X) 3 


this is a reduction formula which gives a simple expression Y, (x) in 
terms of U,,., (x); since we know ), (x) and , (x), therefore with the 
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help of this formula we can readily find » (x), V3 (x) in succession and, 
in general, Y,, (x) for every n. It can readily be seen that in this 
-case we have for every 2: 


Un (x) = [ ster ae = P,(x)e+ C, 


where Py, (x) is a polynomial of the nth degree. 


For further exercises, cf. Problem Book by B.P. Demidovich, 
‘Section ITI, Nos. 123-136*). 


4. Replacement of the variable. We shall now consider how 
‘the formula for differentiating composite functions can be used in 
integral calulus. Let f{(u) be a function which we can integrate and 
F(z) be one of its primitives so that 


F’(u) = f(u), [rea =F(u + C. 


If we take the variable u in place of function of the new variable x, 
wu = ?(x), we have: 


y= By) = F[?()), 


and according to the law for differentiating composite functions 
(assuming that the function ? (x) is differentiable) 


dy = F'[?(x)} ¥" (x) dx = f[? (x)] d? (x) ; 


since this is a differential of the function y = F[?(x)], therefore 
- conversely 


[rte one war = [ s1? 61 a2) = FPO) + ¢ 
Thus if 
[sera = FO +c 
and if (x) is an arbitrary di fferenentiatiable function, then 


[sto @ax = [seoa?@ = FRw@ltc 


*) We should like to draw attention of the reader to the fact that in the 
Problem Book by B.P. Demidovich a primitive is called an integral. 
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In other words: if u = 9(x) and the function ? (x) is differentiable 
while the function f(u) has a primitive, then 


[steele wae =f ste Nae) = [raya (4) 


(where after integration it must be assumed on the right-hand side 
that wu = ?(a). As in integration by parts, the relation (4) only 
replaces finding of one primitive by another primitive; but as before, 
this second primitive may be simpler than the first and it may 
occasionally be known; in that event the first primitive can also be 
written down. 


Every function f («) whose primitive can be found together with 
the relation (4) thus enables us to write an infinite number of ‘new 
primitives which are obtained from the left-hand side of this relation 
by an arbitrary choice of the differentiable function u = (x). 
However, because of the freedom of choosing. the function ? (x) the 
method of replacing the variable (this is the name given to the method of 
integration we are now considering) *) requires the development of a 
special inventiveness which here, as in the method of integration by 
parts, can only be acquired as a result of long practice. In every case 
the following question arises: we wish to find the primitive of a 
function ?(x); in order to do this we must choose a differentiable- 
function ? (x) so that 


¥ (x) =/Te (x)] 90), 
or, which is the same, 
Y (x) dx = f[ 9(x)] de (x), 


where the primitive of the function /(u) 
[s (wu) du = F(u) + C 


is known; if we succeed in doing this, we can simply write in accor- 


dance with (4) : 
[e@a=Fei@l+e, 


and our problem is solved. The whole difficulty of this method’ 
consists in finding the appropriate function 9 (*). In this case it is also- 


*) This method is also sometimes known as the substitution method. 
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‘best to illustrate our arguments by means of examples wich are given 
‘below, and this might prove helpful. 


Example 3. Lvaluate 


axe 
[ean xdx = [. sin ¥ 
cos x 





‘Owing to the fact that sin x dx = — d cos «, we have 
d cos x 
fran xdx = — {- ; 
cos ¥ 
at is therefore natural to assume that cos x = u: hence assuming 
that f(u) = 1/u, o(*) = cos x in formula (4) we obtain : 
d cos * du 
[ tanxdv= — | De ets —= —Inju|/+C= 
cos x u 
= — In| cos x| + C, 


aud our problem is solved. 
Similarly, assuming that u = sin x we find : 


dsnx _ 
sin x 


[ cot vas = [B= le) +6 = In] sins} +6. 

Both these problems are particular cases of the following very 
‘general problem. Let ?(x) be a differentiable function and it is 
required to find the primitive of the function ? (x) /? (x). Assuming 
that ? (x) = u, we find that *’ (x) dv = du and therefore 


2 (x) 4 = [4- = 2( 

lege Injw| + C= In! P(x)| + C. 
Hence 

x dx 1 f2xdx oJ re 

fee oie 2 ee 

e* dx * 
{EA =In(e* + 1)4+ G 

and so on. 


Example 4. Evaluate the primitive 


| dK 
l+V14 20 
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Since the numerator of the integrand is, with an accuracy upto. 
the constant term, equal to the differential of the sum 1 + x? which 
stands under the radical sign in the denominator, we must try to- 
replace this radical by the new variable 








ua Vig 2; 
hence 
ties rr a = a : 
and therefore 
xdx = udu; 
we obtain : 
ae a {= 
I+ Yli+x Lae (5) 


i.e, we arc replacing thefinding of the given primitive by another- 
much simpler primitive which, as we are now going to show, can: 
readily be evaluated as a result of another transformation of the- 
variable. Assuming that | + vw = v we have: 


w@ = p-- l, du = do, 


and therefore 


u dit v— 1 dv : 
rae =| ; ‘do = [do— [=v —ino+6= 





=1l+u-—-In(l+u)+C; 
thus equation (5) gives : 
xdx 


ee V/] ea = Vi x8 — In (1 4+. 4°) + C, 


where C¥ = 1 + Cis an arbitrary constant. 


We have solved our problem with the help of the transfor-— 
mation u = +/{ ++ x2, but we might have equally tried to introduce 
the new variable not in the form of a radical but in the form of the 
expression under the symbol of the radical, viz. 1 + x?; in this case 
we would, have had : 


w= 1+ 5°, du=2xdx, xdx = 5 du, 
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and 


; vdx 1 | du 
Levee 2 


b+ vu’ 
This new primitive is also too simple. Assuming that 


T+ Wy = vwe have: 
u=(v— 1, du = 2(v — 1)d, 


a du = (ete: 
2jiaeate ee 


this is exactly the same primitive which we have obtained asa _ result: 

_of our first transformation of the variable. We can therefore see that 
in certain cases different substitutions of the variable give the same. 
result. 


and therefore 





Example 5. When integrating functions one frequently meets. 
the following elementary problem : the primitive of the function f(x) 


[re dx = F(x) + C 


is known; we are required to evaluate the primitive of the function- 
f(ax) where a is a given constant number. Let us assume that a 4 0 
(when a = 0, f(ax) = f(0) is a constant and the problem becomes. 
trivial) and that ax = uso that dx = du/a; in this case 


1 l 
[ flaxyax a [re M1 FW) +0 = = Fla) +. 
Therefore if 
| f(x) de = FQ) + 
and a = 0, then 


| flax) dx = + F(ax) + C. 


Thus 
{ sin kxdx = — + cos kx + C, 
[5 Pe + arcsin (ax) + C,. 
1 — ax? 


and so on. 
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We are also frequently faced with the converse problem when 
we are unable to integrate the function f(u) and we are using 
formula (4) in the reverse direction, as it were, by replacing the 
difficult expression on the right-hand side of the primitive which 
stands on the left-hand side of the equation; when the choice of the 
function (x) is favourable, our problem may thus be simplified. 
Hence it is difficult to find the primitive 


| V1 — udu 


-directly; assuming that u = sina, —w#/2<x <w/2, we obtain, 
-according to formula (4) : 


| /1 — udu = | costaas 


the reader can find the last primitive by himself : 


[ cov sav = > (x + sm x cos x} + C; 


here « = arcsin wv, sin x = u, cos x = /] — 42 and we have: 


| V1 — utdu= > (arcsin wv + uw Vi — wW) + C, 


For further exercises, cf. Problem Book by B. P. Demidovich, 
‘Section III, Nos. 28-60, 101-120. 


The methods dealt in this paragraph include all the simpler 
methods for integration of functions; there are a few methods and, 
as a rule, they do not solve all the problems we are likely to 
encounter; these methods cannot be applied mechanically but 
necessitate the choice of special approaches to every problem. 
Nevertheless, they enable us to imtegrate a fairly large class of 
elementary functions. We shall return to this problem in chapter 16. 
At present we shall introduce an entirely new approach to the funda- 
mental problem of integral calculus—a method which considerably 
widens and strengthens the relationship between this science and the 
real world—it is a mathematical apparatus for accurate study of 
nature and technique. 


CHAPTER XII 
INTEGRAL 


§ 44. Area of a curvilinear trapezium 


We shall now consider a number of problems -encountered in 
different branches of science, which are inter-related by the fact that 
they all require a mathematical apparatus for their solution. At first 
this apparatus appears to have no connection with differentiation and 
integration of functions ; historically it developed over a long period 
quite independently of these two operations. However, as far back 
as the end of the 17th century it became clear that a general method 
for the solution of such problems could be developed in connection 
with definite problems of integral calculus. We shall soon see how 
this can be done. 


In elementary geometry we have learnt to evaluate areas of 
figures bounded by straight lines and circular arcs. Areas of plane 
surfaces bounded by arbitrary curves can only be evaluated geome- 
trically by means of mathematical analysis. -The theoretical and 
practical significance of this problem is self-evident and does not re- 
quire special explanations. 


The figure bounded by an arbitrary curve (Fig. 27) can be 
divided by some mutually perpendicular lines into several parts, each 
of which represents a “curvilinear trapezium”, t.e. a figure bounded 
on three sides by straight lines, one pair of which is parallel, and the 
third side is perpendicular to the other two (Fig. 28) ; the fourth side 
is an arc of an arbitrary curve which is intersected only at one point 
by an arbitrary straight line parallel to the lateral of the trapezium. 
We do not exclude the case (Fig. 29) when one of the two parallel 
sides becomes a point and we have a curvilinear triangle instead of a 
curvilinear trapezium. We can therefore restrict ourselves to the 
evaluation of area of a curvilinear trapezium. 
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Let us choose the system of rectangular co-ordinates such that 
the side of the trapezium opposite to its curvilinear side lies along 
the OX-aris and the trapezium itself above that axis (Fig. 30). Let 
us denote by a and b (a < 3b) the abscissae of the ends of the lower 
side (“‘base’’) of the trapezium, and let the upper curvilinear side be 
the function y = f (x). 


We are required to find the area § of our curvilinear trapezium. 
We must, however, remember that the area ofa figure bounded by 


Fig. 27. Fig. 28. Fig. 29, 


an arbitrary curve has not so far been defined — in elementary geo- 
metry this concept is only defined for figures bounded by straight. 
lines (polygons) and for parts of circles. Hence we are faced with 
exactly the same type of problem as in § 26 when we were trying to 
define the instantaneous velocity of non-uniform motion ; here, as 
before, we have-a two-fold problem : we must define the required 
area and find a method for its evaluation. 
And again, as before, we shall solve these 
problems simultancously. 


Let us recall the fact that while evalua- 
ting the area of acircle in elementary geo- 
metry we use a fundamental operation of 
mathematical analysis, z.e. the limiting pro- 
cess ; we define the area of acircle as limit 
of area ofa polygon which can be evaluated . 

Fig. 30. by elementary methods. It is therefore 

natural to use this method in the general 

case. For this purpose we divide the base (a, b) of our trapeeium into 

an arbitrary number of parts (sections) whose points of division 

X41, Xqy +++) Xn lie between a and 5, and letusassume that, in general, 
a = XxX, b = x» So that 





A= Ry Se <kty eS e See HS 
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The sections ( x4-1, *,) (1 <& <n) into which we have divided the 
segment (a, 6) can be arbitrary in lengthand generally differ from one 
another. The set of these points of division x, (0 < k < n) is called 
“division” of the base (a, 0). 


Let us now select an arbitrary section (x,-1, «,) on the divided 
segment and take on it an arbitrary point x,, which can either lie on 
this segment or coincide with one of its either 
ends (x,-1 <&,% < xx); we draw a perpendi- 
cular from the point &, to the OX-axis and 
produce it to intersect the curve y =f (x) at 
the point M whose ordinate is evidently equal 
to f (,) (Fig. 31). We draw through the point 
M a straight line parallel to the OX-axis to 
intersect the straight lines x = »;,-) and x=1x;; 
the shaded rectangle in Fig. 31 thus has the 
segment x; — *,-, as its base and _ height 
equal to f (€,), and therefore its area is equal 


to f (3x) (x~ — *x-1)- 


If we now repeat this construction on every segment (x ;-), x ;) 
(1 <k& <n), where the point €; is chosen quite arbitrarily in each 
case on the corresponcing segment, then the set of the shaded 
rectangles forms a “‘ladder”-type figure bounded _ by straight lines 
(Fig. 32). The appearance of this figure evidently depends on 
‘the division of the segment (a, 6) and the chosen positions of the 
points £, on individual sections of this division. It can readily be 
seen, however, that provided this division is sufficiently fine (Fig. 33), 
the shaded figure differs by very little from our curvillnear trapezium 
for all arbitrary positions of the points ,. Let us denote the area of 
shaded figure by S*. It is equal to sum of the areas of its component 


rectangles : 





S* = Mie) (we — XpH1): 
k=1 


If we now divide the segment (a, 2) more and more finely, 
choose the points & ;, arbitrarily on each section and evaluate area S* 
of the shaded ladder-like figure, then it is to be expected that S* of 
the shaded figure will in this process tend to a definite limit S which 
can be called the area of the given curvilinear trapezium. In this 
definition of the area S we are still influenced, in spite of our visual 
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representation, by the analogy with the definition of the area ofa 
circle in elementary geometry, for in that case the area is also defined 
as limit of areas: of polygons which approach the given circle more 
and more closely. 


We therefore naturally arrive at the definition 


S = lim S* =e lim WF Ex) (x — X p-1)- 


k=1 


However, this is not our goal. What does the limiting process 
involve ? How can this process be described mathematically? We 
know (§ 13) that a limiting process is described by the behaviour of 
a certain quantity which we accept as the “‘basic”’ variable. What, 
then, is this quantity and how does it behave in this casc ? 





Fig. 33. 


We have described the limiting process as an infinite division of 
the segment (a, 6). Let T be one such division; let us denote by 
1 (T) the length of the longest of the segments (x4, xz) (1 Ck <n) 
(it is evident that for every division T this number /(T) is defined 
uniquely). We can therefore agree that the variable division T 
*‘becomes infinitely fine’”’ as 1 (7) —» 0, 7.e. when the length of the 
longest of the segments (x z-; , x4) tends to zero, and we can there- 
fore write 


S= limS* = li : Sey eae 
1(T) > 0 ayo BT (xp — ¥ 4-4). (1) 


This means that we choose / (T) as the basic variable of this process 
and describe our process by the relation /(T) > 0. It must, how- 
ever, be remembered that $*, whose limit we are trying to find, is 
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nota function of / (7): it is obvious that onc value of / (T) corrcs- 
ponds to an infinite number of divisions T apart from the fact that 
even when the division T is selected, we can choose the points &z in 
an infinite number of ways; the quantity S* essentially dcpends on 
all these arbitrary elements and therefore it can take an infinitc 
number of values for a given value of /(T). 


Hence we are here dealing with the concept of limiting proccss 
in its wider sense as considered in detail in § 15. The quantity $* in 
which we are interested participates in a process described by the 
relation / (J) - 0, where S* is not a function of the basic variable 
2(T), for it can take an infinite number of values for the given value 
1(T). However, we know that we can nevertheless ascribe a definite 
limit S to the quantity S*. The relation 


has, in this case, the following exact meaning: no maiter how small 
e > 0, we can find a § > O such that for every division T, where 1 (T) < 8, 
and for every choice of the points £% we have : 

| S* — S| <e. 


Such a definition is quite natural. For example, if the quantity 
S * tends to different limits for different divisions T or for different 
choices of the points ;, then it would be difficult to say which of 
these limits measures the area of our curvilinear trapezium. It 
follows from our definition that the limit (1) is, in this case, absent 
and we can therefore ascribe no definite area to our curvilinear 


trapezium. 
If the condition stated in our definition is satisfied, we simply 


say that S* -> S when the division becomes infinitely fine. We thus 
arrive at the following definition for the area of our curvilinear 


trapezium : 
in 
, Of the sum S* = y) S(En (te — ey) tends to a definite limit 
k=] 
when the division becomes infinitely fine, then this limit is said to be the area 
of the given curvilinear trapezium. 


A more formal but equivalent definition is as follows : 


The number S is said to be the area of the given curvilinear trapezium 
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if there corresponds a 8 > O to every © > O such that for every division T for 
which l(T) < 8 and for every choice of the points &, we have 


nN F | 
! y) Peg) ee eee) eS ee 


k= 1 


We have thus completely solved the first part of our problem: 
we have defined the area of a curvilinear trapezium. With regard 
to the second part, i.e. finding an apparatus for definite evaluation 
of this area, we can say that this, too, is solved in principle, for the 
determining formula (1) shows a succession of all operations which 
must be performed in order to obtain a result; however, from a 
practical point of view this method is not very suitable; apart from 
the fact that even for one definite divison T and one choice of points 
E,, the evaluation of limit of such a complicated expression can only 
be performed in a very few simple cases; we must also remember that 
it is necessary to prove every time the independence of the evaluated 
limit from the selected system of divisions and the choice of the 
points ,, which, in majority of cases, is very difficult. ‘Therefore 
this method cannot be successfully used for the solution of specific 
problems. It is, however, interesting to note that in the past, when 
more acceptable methods of solution were unknown, these problems 
were solved by this direct method. Thus in ancient Grecce this 
problem was solved when the curve y = f(x) was a parabola (for 
example f(x) = ax*, where a is a constant). 


§ 45. Work done by a variable force 


Let us assume that a body moves along a straight line OX under 
the influcnce of a force P which acts parallel to this line and that 
the direction of the force coincides with the direction in which the 
‘body moves. If this force is constant, i.e. its magnitude is the same 
at every point x on the line OA, then the work HW’ done by this force 
P along any section of this straight line is, as we know, product of 
the force P and the length of the selected section s : 


IV = Ps, 


Thus if the body falls from a height # on the ground under the 
influence of its weight P, then the force of gravity (which we can 
regard as constant for the duration of fall) performs the work Ph 


in the process, 
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Let us now assume that the body moves along the samc line 
under the influence of a force which varies on different sections of 
the path. We can, for example, imagine that a source is situated at 
a point on the straight line OY which attracts or repels our body 
with a force P proportional to the distance betwcen them (such are, 
for example, the forces of earth’s gravity, the forces of electric or 
magnetic attraction and repulsion, efc.). In this case the force 
P = P(x) is a function of the abscissa x of the point at which the 
body is situated at the given instant. Let us assume that the body 
is displaced by this variable force from the point a on the line OX to 
the point 6 on the same line. How can we find the work HV done 
by the force P in this displacement ? 


We note, first of all, that we have not yet defined the concept 
of work due to a variable force. Hence we are again confronted 
with a two-fold problem—we must define this new concept in its 
general form and also find a practical apparatus for the evaluation of 
the work done by the variable force. 


Let us divide the segment (a, 4) arbitrarily by means of the 
following points of division 


@ = Xo < Hy Ke Se ye SO 


in the same way as we did in the previous paragraph and again 
select an arbitrary poin &; oneachisection (x4-1, +x) (1 </& <n). The 
force acting on the body at the point €; is equal to P(g,’. If this 
force remains constant along the whole length of the section (xz-,, xx), 
then the work along this section is equal to 


P (Ex) (xe — Xe-1)- (1) 


In fact, however, this force varies at different points on the section 
(xp-1, xz) and therefore the work wy, along this section differs from 
that given by the above product. However, if the section (xp, ¥¢) 
is very small, we can assume that the force P (x) changes very slightly 
only along its length and therefore its values at different points on 
this section differ very little from its value at the selected point &;. 
If this is so, we can naturally assume that the work w, done by the 
force P varies very little along the section (x;-), tz) as comparcd to 
the work done by a constant force along that section, which is equal 
to P(E,). This latter work can be expressed by the product (1), and 


we can therefore assume that 


wy MS P(Ex) (xe — xk-1)- (2) 
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This argument can be repeated for all sections into which we have 
divided the segment (4, 0), i.e. for-allk (1 < k <n). 


Further, we are naturally also assuming that the work IV done 
by the force P along the whole length of the segment (a, 4) is equal 
to sum of the works along all the sections (x,_1, x,) into which we have 
divided the segment (a, 5), 2.¢. 


n 


W= » TU 


k=1 


Since we have assumed that w; is approximately equal to the 
product P(€x) (x;—-*s-1), we must naturally assume further that 


n 
WOY)P (Ee) (se — xe). (3) 
k=1 


This approximate expression for the work done will be more 
accurate if the approximated equations (2) are more accurate. And 
these equations will, in their turn, be the more accurate, the smaller 
the sections (x,-), X;) are, t.e. the finer our division 7 of the segment 
(a, b) are. Hence we must consider the approximate equation (3) to 
be more accurate, the smaller the divisions T are. It will therefore be 
quite in order to determine the exact value of the work W done by 
our variable force as the limit of the sum 


Y) P (Ex) (xe — xa), 


k=] 
as the division of the segment becomes indefinitely finer. 


The structure of this sum is analogous to the sum which defines 
in § 44 the area of a curvilinear trapezium. And since we have 
again used a limiting process in order to determine, the work W 
done by the variable force P, we can repeat word by word all argu- 
ments relating to limiting process. The formula 


n 


W= lim Y' P(e) (xp — x 
ee (En) (se — 2-4) (4) 
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denotes here, as before, the following : no matter how small < > 0, a 
5 > 0 can be found such that for every division T of the segment (a, 5), 
provided 1(T) < 8, and for every arbitrary choice of the points 


Er(xer SS, Sap, l Sk <n) 
we have: 


n 


1 — Y P(e) (xe — tea) | <e. 
k=1 





Only if this condition is satisfied, we can say that the number 
WV gives the work done by the force P along the segment (a, 8); 
however, if, for example, for different systems of division or for 
different selections of the points &% we obtain different limits for the 
sum 


n 


- P(E) (%e — *i-1); 
k=1 


then it would be preferable to assume that the work done by the force 
P along the segment (a, 5) has no definlte value. 


We thus see again that the first partof our problem (definition 
of the general concept of work done by a variable force) is com- 
pletely solved whereas the second part (finding an apparatus for the 
practical evaluation of this work) is only solved in principle: the 
practital unsuitability of formula (4) justifies the repetition of all 
arguments used in § 44 in connection with an analogous formula. 


§ 46, General concept of an integral 


We have considered in §§ 44 and 45 two problems belonging to 
two different brauches of science—one to geometry and the other to 
physics. While disregarding the actual contents of these problems 
and concentrating our attention on their analytical structure we can 
see that they resemble each other very closely. In either case the 
solution of the problem involves evaluation of limit of a sum of 
definite structure. 


In geometry, physics, technical processes, science and in other 
fields of human activity many problems occur stich that their analyti- 
cal structure closely resembles the structure of the problems considered 
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above; in future we shall frequently deal with problems of this kind. 
It can, therefore, readily be understood that the limiting process of the 
described type deserves special attention and must be studied in all 
its aspects, for it is one of the most important problems of mathe- 
matical analysis. We shall now study it in detail. 


Let the function f(x) be defined in the interval (a, 0). Let us 
subject this interval to a division T by means of the following points 
of division 


Ba hye Ry es Sp Ss 


and denote the length of the longest section (x1, xx) (k = 1, 2,...,n) 
by /(T). Let us then select on every section (x ,-), *,) an arbitrary 
point &y (4-1 <&,% <x,) and construct the sum 


n 
S = Y) FED = Xk-1)3 
k=1 


this sum evidently depends on our division T and on the choice of 
the points —,. 

Let us now agree to say that the sum S, as the division T becomes 
indefinitely finer (or, which is the same, as I(T) —> 0), tends to ihe limit I 
if the following condition is satisfied: no matter how smalle > 0,a8 > 0 
can be found such thai for every division T and provided (T) < § we have for 
every arbitrary choice of the points & » , 


S—li<e, 
This fact can be denoted as follows 


n 

lim $= lim Veen os = 

iT) > 0 «rao Le We —~ tea) = 
=] ° 


The number J, in case it exists, evidently depends only on the 
form of the function f(x) and on the interval (a, 6). We shall call 
it integral of the function f (x) from a to } [or in the interval (a b)] and 
we denote it as follows : : 


b. 


74 
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neither the term “‘integral”’ nor the familiar symbol! f should, for the 
time being, be subjectively connected with the term ‘‘integration” and 
with the context in which this symbol was used before; we have 
established this connection at the same time. We should regard the 
notation (1) (and this point of view is justified historically) as an 
abbreviated notation of the sum S; if we simply want to describe the 
structure of this sum without going into details as to the system of 
division or the choice of the point €; and if we only want to fix the 
function fand the interval (a, 6), then we can write (disregarding 
accuracy of our symbolic notation) 


S= Vi sfle) ax, 


a 


where Ax denotes the increment of x in the transition from one point 
of division to the next. If we further note that Ax = dx and denote 
the summation not by the Greek symbol 2 but (as it was, in fact, 
done in the past) by the Latin letter S$, we obtain: 


S=$ f(x) dx, 


and we can agree to denote the limit of this expression by the same 
somewhat deformed summation sign 5; one such deformation can be 
the symbol f and such is, in fact, its historical origin. We thus arrive 
at the formula , 

b 


I= lim $= | f(s) ds 


a 


The numbers a and # are known as limits of integration (a being 
lower and 4 upper) and the interval (a, 5) as interval of integration; the 
function f(x) is known as integrand and the product f(x) dv as 
integrand expression. 


The function {(x) which has an integral in the interval (a, 5) is 
said to be infegreable in that interval. It can readily be seen that only 
a function which is bound in the interval (a, 6) can be integreable. 
In fact, if f(x) is not bounded in the interval (a, 5), then for every 
division 7 it will be unbounded and at least in one of the sections 
(xp-3) h) = An If, for example, f(x) assumes as large a valueaswe 
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please in Ax, then by choosing the point &, in the usual way in this 
section we can make /(#;,), and therefore the sum 


Ys SE) Ge = ra) 


r=1 


as large as we please; therefore this sum cannot tend to a Ilmit as 


1(T) > 0. 


Hence the provision that the function be bounded is the 
necessary conditicn for it to be integreable in the given interval. 
However, this condition is not sufficient. We shall learn one very 
convenient rule for the necessary and sufficient condition in § 48. 


We must now study methods for evaluation of integrals for as 
wide a class of integrands as possible. We have already said in §§ 44 
and 45 that the direct method for evaluation of such integrals as limit 
of a sum of a definite structure is not convenient practically and can 
only be used in a very few simple cases; generally speaking, it is too 
complicated to use. We must therefore try to find other more 
applicable and practical methods for this purpose. 


§ 47. Upper and lower sums 


In § 46 we have defined an integral as limit of a sum 


Ys Es) Ar 


k=1 


which is frequently called an integral sum. The value of this sum 
depends on the given division T of the interval (a,b) and on the 
choice of the points &;, in the sections A;. Tor further development 
of integral calculus it is convenient to introduce sums of another 
kind which correspond to the given division T, 


Let us assume that we are given a bonded function f(x) in the 
interval (a,b) and let AZ and m denote respectively its upper and 
lower bounds in this interval. Let us divide the interval (a, b) by 
means of the usual division 7 with points of divison 


CA Ee i Sy 


let us denote the section (v;,~1, *,) and its length by the same symbol 
Ay. Let M;, and m, respectively denote the upper and lower bounds 


INTEGRAL 205 


the function f(x) in the section A, (1 <k <n). We canthen 
construct the sums 


n n 
SIT) = Vi My Aw s(T) = y) m, Ae 
k=1 k=] 


It is evident that both sums are defined uniquely by the division T 
and are independent of further arbitrary elements. We shall call 
S(T) the upper and s(T) the lower sum corresponding to the given 
division 7. We must now study some properties ‘of these sums. 


1°. Owing to the fact that m; </(&%) < M, for every 
choice of the point €; in the section A ;, we have 


n n n 


s(T) = Pimz Ae < PEs) Av < Yo My Ax = S(T) 
k=1 k=1 k=1 


i.e. every integral sum which corresponds to the given division is confined 
between the upper and lower sums of this division. 


2°. Let « > 0 be as small as we please. It follows from the 
definition of the upper bound that we can choose a point €; in every 
section A ;, such that f(€;) > M,; — «; but in this case 


n n n 


Yrs) A> Yo Ma Ac— ©} A= S(T) — © (0 — a), 
k=1 k=1 k=1 


Together with the inequality 
1 

VE) Ae < S(T), 
k=1 


which, as a result of 1° applies to every integral sum, this shows that 
the upper sum of the division T is the upper bound of all integral sums which 
correspond to this division. Similarly the lower sum of the division T ts the 
lower bound of all integral sums which correspond to this division. 


3°, Let Y and T’ be two arbitrary divisions of the interval 
(a, 6). Let Ax, My and m;, have their former meanings for the 
division T and let A”, .M;, and m’, denote the corresponding 
values for the division T’. Finally we denote by A x the length of 
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the common part of the section A, and A’; and by My and my 
the upper and lower bounds of the function /f (x) in the section Ax 
(when the section A; and A‘ have no interior points in common, 
we have Ay = 0; the symbols M,,; and m, can, in this case, have 
arbitrary value, for example M,. = my =0). 


We evidently have : 


»} Ax = Axl, > An = A’. 
i k 


mr Mal K Mia < M,, ( = 1, 25 weds 
< 


m1 < Merl < Miz M'; (k= 1% 2, set) 


therefore 


5(T) =) m, Ar = pad my An < ye my Ant < 
k kl kil 
<bL Mit Axl S >: MM’ Ax = 


kl 
=) MM", y An = : MM", A’) = S(T’). 
l k l 


This shows that the lower sum of every division T does not exceed the 
upper sum of any other division T’. 


4°. It follows from 3° that the set of all lower sums is bounded 
from above; let its upper bound be Jy; similarly the set of all upper 
sums is bounded from below; let its lower bound be J°. Owing to 
the fact that no lower sum can exceed the upper sum, it does not 
exceed either the lower bound J° of all upper sums; but if J° is thus 
not smaller than any lower sum, J°® cannot be smaller than the upper 
bound J) of all lower sums. Hence we always have I) <I°, i.e. the 
upper bound of all lower sums does not exceed the lower bound of all upper 
sums. 


By using the established properties of upper and lower sums we 
can in the next paragraph deduce many important properties of 
functions in which we are interested. 
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§ 48. Integrability of functions 


We shall follow the notation uscd in the previous two para- 
graphs. At first we shall prove the following necessary and sufficient 
condition for integrability of a function in an interval. 


Theorem 1. (criterion of integrability). In order that the bounded 
function f(x) should be integrable in the interval (a, b) it is necessary and 
Sufficient that 

lim [S (7) — s (T)] = 90. 
“T)~ 0 

Note 1. As always, the relation (1) means: no matter how small 
¢ > 0,a8 > 0 can be found such that for any division T of the in- 
terval (a, 5) which satisfies the incquality 1(T) <6 the inequality 
S(T) —s(T) < <also holds. 


Note 2. The difference wo, = M, —m, betweenthe upper and 
lower bounds of the function f (x) in the section A; is known as its 
variation in that interval.~ It follows from the definition of the sums 
S (1) and s (T) that the relation (1) can also be written in the form 


n 


lim Op, A, = Oz. 
L(T)—>0 


Proof. 1. Necessity. Let it be given that the function f (x) is 
integrable in the interval (a, 5); let us denote its integral by Z. For 
any division J with a sufficiently fine / (7) any integral sum 3(T) 
will differ from J by less than < and it follows 2° § 47 that S(T) and 
s(T) are respectively the upper and lowerbounds of the integral sums 
=(T); therefore none of these sums differs from J by more than «. 
It therefore follows that 


S(T) — s(T) < 2e, 


the only condition being that / (7) is sufficiently small, and sinee ¢ is 
as small as we please, the relation (1) is proved. 


2. Sufficiency. Let the function f (x) satisfy the relation (1) in 
the interval (a, 5). It follows from 4° § 47 that for every divisio.i 7 


we have 


S(T) <H<P<S (1), 
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and for a sufficiently small / (T) the difference S (7) — s (7) is as 
small as ;we please ; therefore J, = J°; denoting by J the common 
value of these two quantities we obtain for any division T 


s(T) <I < S(T), 
and it also follows from 1° § 47 that 
s(T) <2 (T) <8 (7), 
where 3% (7) is any integral sum which corresponds to the division T. 
It follows from the last inequalities that 
|2(T) —I| <S(T) —s(T), 


where.T is an arbitrary division of the interval (a, 6) and S(T) is an 
arbitrary integral sum which corresponds to this division. But provid- 
ed I {T) is sufficiently small, S (7) — s(7T) becomes as small as we 
please as a result of (1) ; the same condition therefore also applies to 
| 2 (7) — J|, and this means that J is the integral of the function 
J {*) in the interval (a, 6), Hence theorem | is fully proved. 


Theorem 2. If the bounds function f (x) is integrable in the interval 
(a, b), then the function | f (x) |ts also integreable in that interval. 


Proof. Denote by w, and w*, the respective variations of the 
functions f (x) and | f (x) | in the section A;,. It can readily be seen 
that if the bounds Mand m, of the function / (x) have the same signs 
in the section A,, then 

wo*, == wo, =M, — TM ke 
If, however, the signs of MZ, and m, are opposite, then 
ot, <|My| +] mel = My — my = oj. 
Hence in all cases, < w*,. It therefore follows from 
n 
Vo. A; > 0 
k=1 
that 


n 
* 
y QO Arm 0, 
k=1 
and in view of theorem | this theorem is proved 
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The proved criterion of integrability (theorem 1) enables us to 
establish existence of integrals for very wide classes of functions. 


Theorem 3. Every function f (x) which is continuous in the interval 
(a, b) ts integreable in this interval. 


The great importance of this theorem is obvious. It shows, for 
example, that the curvilinear trapezium which is bounded from above 
(cf § 44) by a continuous curve always has a definite area. 


Proof. The function f (x) is continuous in the interval (a, 6) ; 
it follows from theorem 5 § 23 that it is uniformly continuous in that 
interval. This implies as follows : for every ¢ > 0,a 8 > 0 can be 
found such that if x,-*,<8(a <x, < x, <5), then| f (x2) —f(*) I<. 
Let 7 denote any division of the interval (a, 6) for which / (T) < 6. 
Since the function f (x) is continuous, it assumes in every section A, 
its minimum value [ (é’ ,) and its maximum value f(&”";) (theorem 
2 § 23); it is therefore evident that f (&’,) = m, and f (§",) = M;, so 
that 


n 


Yor Ax = Lf (E"n) — f (Se) Axi 
k=1 k=1 


but &, and &”, belong, to the same section A,, whose length is less 
than 8 ; therefore f (&",) + (&,) < ¢ and we have: 


n n 


s 0) i Ar<e Ax =e(b — a), 
k=1 k=1 

the only condition being that / (7) <6. This means that our cri- 
terion is satisfied and therefore the function f(x) is integrable in the 
interval (a, 5). 

Theorem 4. Every funetion f (x) which is bounded in the interval 
(a, 6) and has only a finite number of points of discontinuity on it 1s integrable 
in that interval. 

_ Let the points of discontinuity of the function f (x) in the inter- 


val (a, b) be as follows (in increasing order): 04, %, ... » %r, and Iet € 
be an arbitrary positive number. We denote by d; the section 


(ai #45 +e) (1 St <M), 
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and let ¢ be so small that these sections do not overlap in pairs. ‘The 
function f (x) is continuous in every scction (#1 + ¢,%: — ©) (¢f Fig. 
34, wherethese sections are marked). Therefore as in the proof of the 


d,-t . ei aj +h 
Qi-s Qj Qi+s 
Fig. 34. 


previous theorem, we can find for every section a number 5 such that 
the variation of the function / (x) .in any section of length < 6 which 
lies entircly within the marked section is smaller than «. Evidently 
each marked section has its own 8; but since there isonly a finite 
number of such sections, each section will contain the smallest value 
of 8, which we shall in future denote by 8. Hence in any section of 
length < 8 which lies entirely within one marked section (it does not 
matter which one) the variation of the function will be smaller than ¢«. 


Let 7 denote ‘an arbitrary division of the interval (a, 5) for 
which 7 (7) < 5. Let us divide the sections Az of this type into 
two kinds : 


1) sections of the first kind which He entirely within one 
marked section, and 


2) sections of the second kind which have points in common 
with another section d;. 


With this in mind let us divide the sum 


oAar= Pty 


into two sums, Where 2’ refers to all sections of the first kind and 
2" to all sections of the second kind. Since /(T) < 8, therefore 
«, < € for any scction of the first type and therefore 


i ole 


i 


, , ‘i 
y OpAr<e)) Are » Ax=c(b- a). (2) 
k=1 


As far as sections of the second kind are concerned, those sections 
which have points in common with another section d, evidently form 
a section whose length is less than 2 « -+- 2 8, since they all lie in the 
section («;—e—5, a; 4-248); and since the number of sections di is 
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equal tor, the sum of the lengths of all sections of the second kind 
does not exceed 27 (= + 8) ; we can evidently always select 8 < ¢ such 
that the sum of these lengths will be less than4re. And, finally, since 
the variation @ x = Al, — m, of the function f(x) in any section 
does notexceed M—m (i.e. the variation of f (x) in the whole section) 
therefore a 


wn 


y wo,Ax~ & (AL — m) y Ant <x4(M—m)re (3) 


It follows from (2) and (3) that 


n 
Vo oopAr<e{b—-at4 (Mm) r}, 
k=1 


the only condition being that / (JT) < 8; since e > O is as small as 
we please and the remaining letters on the right-hand side of this 
inequality denote constants, our critetion is satisfied and the function 
J (x) is integrable in the interval (a, 6). 


Theorem 5. The function f (x) which ts bounded and monotonic in 
the interval (a, b) ts integreable in that interval. 


This theorem does not follow directly from the preceding 
theorem, since a function which is bounded and monotonic in a given 
interval (a, }) can have an infinite number of points of discontinuity 
in that interval. ‘Thus the function 


0 (x = 0), 
poy} ( 1 <x<—)(n=1,2.), 


n+l] 7" 


n 


which the student should represent graphically, is a bounded non- 
decreasing function in the interval (0, 1); at the same time, however, 
it has points of discontinuity at every one of the points 1/2, 1/3, ..., 
Epipeces 


Proof. Let the function f(*) be non-decreasing in the interval 
(a, 6). It is evident that for any division T of the interval (a, b) we 
have the following expressions for the upper and lower bounds of the 
function f(x) in the interval Ag = ("g-1) ¥x) ¢ 


My, =f xx), me = fra) 
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and therefore 


Viog Ae = Yi Sl) — Slr) } Ae 


k=} k=1 


If (7) <6, then in this sum A, < 5(1 <k <n); and since the 
function f(x,) > f(*,-1), consequently 


{f(%) —F (ten) } An < {fln) — Sti) }8 (Sk <n), 


and this means that 


Vi on Ae <8)! {flx) - f(a) } = 8 { f(b) — f(a) }- 
k=1 k=1 


Since 5 can be chosen as small as we please, 
n 
oO, A,->O [(T) > 0]; 
k=1 
our criterion is thus satisfied and theorem 5 is proved. 


We recommend the following useful exercises from B. P. Demi- 
dovich’s Problem Book : Section IV, Nos. 57, 61, 71, 73. 


CHAPTER XIII 


RELATIONSHIP BETWEEN AN INTEGRAL 
AND A PRIMITIVE 


§ 49. Simple properties of integrals 


In this chapter we shall try to establish the fundamental 
relationship existing between two basic concepts of integral calculus— 
the primitive and the integral, which have so far been considered 
quite independent of one another. In order to do this we must at 
first establish some simple general properties of integrals and we shall 
do so in this paragraph. 


_ Theorem 1. Jf the function f(x) = ¢ is constant in the interval 
(a, b), then 


ra fir iis Fount 


a 


In order to prove this theorem it is sufficient to note that for 
every division TJ and for every choice of the points & we have 


n n 


Vf Ee) (te — tea) = Y) (ete) = 6 (ba), 


k=1 k=l 


and therefore also 


n 
P= lim )) f Es) (te — ea) =6(b — 2). 
i 


l(T) +0 
k= 
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Theorem 2. If f(x) <? (x) (a <x <b) and ? (x) isintegralMe 
in the interval (a, b), then 


b b 
[ se) dx < | P(x) dx. (1) 


Tn fact, it is given in the condition of this theorem that for every 
division T and for every choice of the points &;, 


VF Ex) An < VP Ed Ass 
k=1 


k=] 
hence the limiting process for /(T) + 0 gives the inequality (1). 
The following is a corollary from the theorems | and 2. 


Corollary. If the function f(x) is integrable in interval (a, b) and if 
at an arbitrary point x in this interval m < f(x) <M, where m and M are 
arbitrary numbers, then 


b 
mb—a)< [ 00) ax < M(b — a). 


Theorem 3. Jf the functions f,(x)| and f(x) are integrable in the 
interval (a, b), then the function fy (x) + fe(x) ts also integrable in that 
interval, and 


b b 
[UL de fe@nlér = [floer [fwd Q) 


In order to prove this theorem it is sufficient to note that if we 
denote by %4, 2, and 2 the respective sums of the form 


WHE an) (Xn — X pots 
=I 


which is related to the functions /,, fzand f,; + f, respectively, then 
for every division 7 and for every choice of the points & ; we evidently 
have : 


x= X,+ %,, 


and while taking limiting process for /(T) + 0 we are simultaneously 
proving integrability of the function f, + /, and the equation (2). 
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Theorem 4. Jf the function f(x) is integrable in the interval (a, b) 
and % is an arbitrary constant, then the functton « f(x) is also integrable in the 
tnterval (a, b) and 


b b 


[asrde =a | 6) dx (3) 


(“the constant factor can be taken outside the symbol of integration”’). 


To prove this theorem it is sufficient to note that for every 
division of the interval (a, 5) and for every choice of the points €, 


n 


», af(Ex)(*, — xX.) = & re we) (Xe—* 1) 


k=1 k=1 


and the usual limiting process proves integrability of both the function 
a f(x) and the relation (3). 


Theorem 5. Jf a<a’' <b’ <b (te. if the interval (a’, 6’) 
comprises of a part of the interval (a, 5), then every function which is tntegrable 
in the interval (a, 6) ts also integrable in the interval (a’, 6"). 


Proof. Let it be given that the function f(x) is integrable in 
the interval (a, 6). It follows from the criterion proved in §48 that 
in this case, a 5 > O corresponds to every « > Oso that we always 
have for 1(T) < 8: 


b n 
y= Vopar<s, (4) 
a k=1 


where the sum corresponds to the division 7 of the interval (a, 8). 
Let 7’ be an arbitrary division of the interval (a’, 6’) for which 
UT’) < 8 Let us now divide the intervals (a, a’) and {’, 6) into 
arbitrary sections of length §; we then evidently obtain a division 
T of the interval (a, 6) for which (7) < 6 and therefore it follows 


from (4) 


ae 
a 
y 
But the sum » which corresponds to the division 7’ comprises of a 


a’ 
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b 


part of the sum y) which .corresponds to the division 7, where all 


a 
terms of the latter sum are non-negative. Therefore 


b b 
P< Bes 
the only condition being that ((T’) < §; in terms of our criterion 


this means that f(x) 1 is integrable in the fitenval (a’, b’). 


Theorem 6. Let a<c<_b;in that case every function f(x) which 
is integrable in each of the subintervals (a, c) and (c, b) is also integrable in the 
interval (a, b) and 


——, 
= 
a 
= 
tl 
Roe, 


fix) de + | fix) de. (5) 


Proof. Let 7 be an arbitrary division of the interval (a, d); 
we denote by J’ the division abtained from 7 by adding the point 
¢ as a point of division and by 2(T) and &(7’) the sums of the form 


n 
yi O) i, A ks 
k=1 


which are respectively related to the divisions T and T’. These two 
sums differ from one another only insofar as one term of one sum is 
replaced by two other terms in the transition from 3(T) to Z(T’); 
and since all terms of both sums are infinitely small for (7) > 0, 
therefore 


X(T) — X(T’) +0 [l(T) > 0]. (6) 


But the sum %(7') which we have constructed in the intervals (a, 6) 
can evidently be broken up into two similar sums for the subintervals 
(a, c) and (c, b), each of which, as a result of the assumed integ- 
rability of the function /(x) in subintervals (a,c) and (c, 6) tends to 
zero for (7) —» 0; hence X(T’) +0; but it then follows from (6) 
that 2(7) — 0 for (7) — 0, and this means that the function f(x) is 
integrable in the interval (a, 6). 


We must still prove the relation (5) for the integrals. Since we 
have proved integrability of the function f(x) in the interval (a, 5), 
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there are no other difficulties. In fact, we have in the interval 
(a, b) for 1(T) > 0: 


n b 
$= Peder — rey > [seer = 7G 
k=1 a 


independently of the divisions T and the choice of the points &; ; we 
can, for example, select a division T such that the point ¢ should 
always be a point of division ; but in that case the sum S is broken 
up into two sums S’ and §” of a similar form constructed in the 
subintervals (a, c) and (c, 6) respectively ; it follows from the assump- 
tions of the theorem that these two sums tend respectively to 


c b 
[fede =r and [ro d¢= I" 


for /(7) — 0 so that 


Sf hh ee Poe (8) 
for 1 (7) -> 0 ; it follows from (7) and (8) that 
je ree oe 


and theorem 6 is thus fully proved. 


Corellary. [fa<cy<02< 1... <¢n <b and the function f (x) is 
integrable in each subinterval (a, cy), (C1, Co), -+« » (Cn, 0), then it ts integ- 
rable in the interval (a, b) and 


b 


J rea= [rede fre dx +... + [7e0 dx. 


a 


_ As a result of theorem 5 the condition of integrability of the 
function { (x) in each individual subinterval can be replaced by the 
condition of integrability of this function in the whole interval (a, b) ; 
it follows from theorem 5 that f(x) will then also be integrable in 
every individual subinterval and the corollary remains valid. 


Let us now make one more remark which we shall soon find 
very useful. The integral 


b 
[se as (93 
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(if it exists) depends, according to its definition, only on the following 
elements : 


1) the form of the function f (x), and 


2) the numbers a and b; 
if these elements are given, then the integral is uniquely defined. 
Thus, for example, the integral (9) does not depend on the variable x which 
is usually known as the “variable of integration’. Therefore by 
changing the symbol of this variable ‘we do not alter the integral ; in 
other words, the expressions 


b b b 
[roe [rove [roa, 


etc. always denote one and the same thing. This simple and self- 
evident fact is analogous to fact that, e.g. 


20 20 20 
1 ] 1 
d k? s aL a 
k= l=1 B=1 
etc. all denote the same thing, viz. the sum 
1 1 1 
1 + =e + co + eee + 20° 


This sum is independent of our notation, t.e. of the “index of 
summation’’, in the same way as in our example the value of the 
integral is independent of the symbol used for denoting the variable 
of integration. 


§ 50. Relationship between an integral and a primitive 


We shall now try to establish a law which is usually regarded as 
fundamental in differential and integral calculus, since it serves logi- 
cally and historically as the basis for further development of these 
branches of mathematical analysis. 


Let it be given that the function f(x) is integrable in the interval 
(a, 6) and let a << x <0; it follows from theorem 5 § 49 that the 
function / (*) is also integrable in the subinterval (a, x) ; however, we 
find it inconvenient to denote its integral in that subinterval by 


[so as, 
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for in that case the letter x would be used in two totally different 
meanings : it would be used as the variable of integration and as the 
upper limit of the integral. Therefore using the final remark of § 49 
we shall always denote the variable of integration in such cases by 
another letter, ¢.e., for example, we shall write the integral of the 
function f (x) in the subinterval (a, x) in the form 


x 


[seo du. 


a 


If we now assume that the lower limit a of the integral is cons- 
tant while the upper limit x can change arbitrarily in the interval 
(a, 6), then the above integral will evidently be a function of x which 
we denote by F (x). We shall now prove the following fundamental 
proposition. 


Theorem 1. Jf the function f (x) is integrable in the interval (a, b) 
and continuous at an interior point x in this interval, then the function 


x 
F (x) =[sw du 


as differentiable at the point x and F' (x) = f(x). 


Proof. Leta<x< band Ax >Obesosmallthatx+Ax<ob, 
It then follows from theorem 6 § 49 that 
x+ Ax x 
ret ax — Fe) = [fede [ flo de= 
a a 
x+ Ax 
=| sma. (I) 


x 





*) So as not to exclude the case x = a we should give a difinite meaning to 
a 

the cxpression F (a) = ff (x) dx. It can readily be shown that F (x) > 0 for 
a 


x— a+ 0; we can therefore naturally assume that F (2) = O and we shall always 


do so in future. 
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Since it is given that the function f (x) is continuous at the point 
x, therefore no matter how small « > O we have for a sufficiently 
small Axandx <u <x+ Ax: 


f(x) —e<f(u) < f(x) +, 
and it therefore follows from theorem 2 § 49 that 


x-+ Ax x + Ax x+ Ax 
| [Sf (x) -- e] du < | f (uy du < | [ f(x) + ej du. 
« x x 
Hence we obtain from the relation (1) 
: + Ax x-+ Ax 
2 fife -ad< 


x“ 





R 


In each of the two integrals the integrand is independent of the vari- 
able of integration w and it is therefore a constant. Applying theorem 
1 § 49 to the right and left-hand sides of thé inequalities obtained, 
we therefore have : 


Fix+ Ax) —F 
F (x) e< 4s) (+) 





<flx) +e, 


and since ¢ is as small as we please for a sufficiently small Ax, these 
inequalities show that 
lim 4 A ee 


) 
eet aan Ax =a 





Finally an analogous analysis of the case Ax < 0 (which the reader 
can undertake himself) readily shows that this relation remains valid 
fora <x < band Ax + — 0 and that the function I(x) is there- 
fore differentiable at the point x: hence 


FY (x) = f (x), 
and theorem | is proved. 


Note. We have evidently proved more than what is necessary 
for the statement of theorem I. Apart from the relation F’ (x) = f(x) 
for interior points x in the interval (a, 6), we have also established 
that (assuming that F(a) = 0) 


kim F(a+ Ax)—F (a) FC Ai F (b+ Ax) ~ F (b) 
Ax>+0 Ax Ax+<0 Ax 








=/(0) 
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(provided, of course, f(x) is continuous at the points a and 6 respec- 
tively). It is evidently convenient to say that the function F(x) is 
the primitive of the function f(x) in the interval (a, b) if, together with 
the relation F’ (x) = f(x) for interior points in that interval, the two 
above mentioned limit relations are also satisfied at its end points. 
We shall consider this to be so in future. 


Since the function {(*), continuous in the interval (a, 5), is always 
integrable in that interval (theorem 3 §48), it follows directly from 
theorem | that 


Theorem 2. If the function f(x) 1s continuous in the interval (a, 6), 
‘then the function 


F(x) = {se du 


is the primitive of the function f (x) in that interval. 


In order to appreciate fully the significance of this proposition 
we note that the mere fact, established by this theorem, that a 
primitive exists for every continuous function is completely new to us; 
we have learnt in Chapter XI to find primitives of a few elementary 
functions; however, outside this narrow region of functions the 
problem of existence of primitives remains quite open. 


If we can find integral of the given function f(x) in an 
arbitrary subinterval (a, x), then, as a result of theorem 2, we can 
also find one of the primitives f(x); we know from the results of 
chapter XI that in this case we thus know the whole family of 
primitives f(x). Hence, if we are able to find integral of the given 
function, we can also find all primitives. However, it is much more 
important to note that the results obtained will enable us to solve the 
converse problem: by knowing one of the primitives of the continuous 
function f (x) in the interval (a, b) we can find its integral in that interval. 
In fact, let (x) be an arbitrary primitive of the continuous function 


f(x) in the interval (a, 6). Since 


Fay = | seo) a 
a 
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therefore, as a result of theorem 2, it is also a primitive of this 
function; it follows from the results of chapter XI that the differcnce 
® (x) — F(x) is equal to a constant number C so that 


®()=F(X +6. (2) 


Assuming in this equation that x = a andremembering that f° (2) =C 
we have C = (a). Therefore, assuming in (2) that x = 6 we 
obtain : 


b 
FQ) = | f() du = 0) ~ 0 (a. 


Theorem 3. If ®(x) is an arbitrary primitive of the function f(x) in 
the interval (a, b), then 


b 
[ £) dx = 6) — O(@. 


a 


(3) 


Hence, by knowing any one primitive of the continuous 
function /(x) in the interval (a, 6) we can directly write its integral 
in that interval. The evaluation of integrals 
which has so many different applications 
‘therefore involves finding primitives of 
functions; this problem is of great impor- 
tance in mathematical analysis and in its 
applications, We have already considered 
it in detail in Chapter XI and we shall 
consider it again in Chapters 16 and 17. 





The moment when possibility of 
evaluating integrals by means of primitives 
of functions was fully realised was a turning point in the historical 
development of integral calculus. Prior to it the science of integ- 
ration was at a very unsatisfactory level, since in each case a new 
method had to be found for evaluation of each individual integral; 
it now became possible for the first time to use a single method for 
many divergent classes of functions; it can therefore be said without 
exaggeration that from that moment onwards integral calculus began 
to develop as an independent scientific branch. 


We shall now give one very simple method which illustrates 
effectiveness of formula (3). Let the curve at the top of the curvi- 
linear trapezium (Fig. 25) be a parabola with an equation y=ca?(c>0 
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is a constant). As we have already said the area of a similar 
parabolic trapezium was evaluated by the ancient Greeks (Archimedes), 
but their method, based on the simple evaluation of limits of the 
corresponding sums, required complicated calculations. We are now 
able to write directly the complete solution of this problem by using 
formula (3), The required area is 

b 


Ss = | a dx; 
a 


but the function cx? has the primitive cx?/3 which we can take as the 
function ® (x) in formula (3); therefore 


S = (5) — ® (a) = a (d°—a’), 


which solves our problem. 


For further exercises cf. Problem Book by B.P. Demidovich, 
Section IV, Nos. 1—4. 


§ 51. Further properties of integrals 


In § 49 we have established a series of the simple properties of 
integrals We shall now add some other properties to them. In § 49 
we were trying to establish properties of integrals which would lead 
usin the shortest possible time to formula (3) $50, which ¢onnects 
the integral with the primitive of a function. Now, on the other 
hand, we shall use this formula to dcduce somc other properties of 


integrals. 
1. In the construction of the integral 
b 
[7 de (1) 
J . 
we have so far always assumed that a < 6; however, the right-hand 
side of formula (3) §50 remains fully dcfined even whena > bd. 
Therefore it is natural to ascribe a meaning to the expression (1) for 
every a and 6, defining it with the help of formula (3) §50 when 
a >. Thus for every a (and for every continuous function /) we 
obtain, for example 


[ ste) de = 0 
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and when a > b 
b a 
[ 100 & = - [rae (2) 
a b 


(where we alsohave 6 > a). The relation (2) canbe stated as follows: 
if the limits of integration are interchanged, the integral changes its sign. 


In all these considerations we have assumed that the function 
f(x) is continuous in the interval (4, b); it is, however, natural to go 
b 


further and assume that the relation (2) defines the integral | SI (x) dx 


a 
for b < a for every funtion f(x) which is integrable in the interval (a, 5). 
From now on we shall accept this definition. 


Let us also draw attention to the fact that if b = a, the formula 
(3) §50 gives: 


f reas = 0; 


* we have accepted this equation in §50. We can now see that this 
agreement fully confirms with formula (3) § 50. 


On the right-hand side of formula (3) §50 we have the difference 
(5) — O(a) of values of the function @(x) for x = 6 and x =a, 
° b 


This difference is frequently denoted as follows: ®(x)| and known 
a 
as the ‘‘substitution”’ of the function ® (x) from a to b. 


Since, according to formula (3) §50, the primitive can be 


written in the form f§ f(x)dx, we can rewrite this formula in an equi- 
valent form as 


|b 


[ s dx = ([ 7 di . (3) 


Example 1. 
1 


1 
| 6x? as = (Qx9)| =2-16=— 14 
2 





AN INTEGRAL AND A PRIMITIVE 225 
2. The law of integration by parts for primitives has the form 
[was = uv — [ max; 


substituting on both sides from a to } we find according to the formula 


(3): 


b ; b 

[uo’ as = (wo = fouras. (4) 
a 

a a 


This is the formula of integration by parts for integrals, 


Example 2. Let us evaluate the integral 
é€ 
| In x dx, 
1 


and we do not remember the primitive of the function In x. Assuming 
; ] 
u=Inx, uv = pee: 
COS re, 


we find with the help of formula (4): 


é é 
in xdx = eins (= [d= ele 1in 1 —(e—1) = 1. 
1 





For further examples cf. Problem Book by B.P. Demidovich, 
Section IV, Nos. 15-17. 


3. The method of integration by replacement of the variable is 
based on formula (7) §43: when u = ? (x), we have: 


[ so au = | Flecone (yar. (5) 


The left-hand side of this formula denotes the primitive F(x) of the 
function f(u) in which we have replaced u by ?(x), i.e. F[P(x)]. 
Therefore substituting from a to J on both sides of formula (5) we 
obtain ; 

b ; $(d) 

f foo 9G) ds = Feel] ” = PION — FIea] = | fo) de 


a (2) 


226. A COURSE OF. MATHEMATICAL ANALYSIS 


+ Hence if the function ?(x) has ‘a continuous derivative in the 
interval (a, 6) and the function f(z) is continuous in the interval 
[? (a), 9(8)], he 


oa (0) 
[ ftoome @ dx = | sede. 
a @(a) 


This is the formula of replacement of the variable for integrals. 


Example 3. Assuming that « = ?(x) = cos * we have: 


7 Fd _t /2 
4 4 ) mer’ mo 

a ?' (x) dx _ du : _ i 
fran xdx = — Pers cee ons Fan In 2. 
0 0 ces 0 


4. Mean value theorem. Let Mand m denote the upper and 
lower bounds, respectively, of the integrable function f(x) in the 
interval (a, 6). It follows from the corollary of theorem 2 § 49 that 


m(b—a)< [re dx <.M (b — a), 


and therefore 


b 


m< Pearl FiO) dx <M, (6) 
a 


These inequalities apply to every function f(x) integrable in the 
interval (a, 6). If f(x) is,;continuous in that interval, then it follows 
from theorem 3 §23 that it should assume an arbitrary value between 
its lowest value m and greatest value M in the interval (a, b). But 
the inequality (6) shows, that this condition is satisfied by the number 

, : 
rs | 
a F(x) dx ; 


a 


\ 


therefore a point ¢ can be found ais a and b such that 


Bete 1S at [i f(x) dx, 7 
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or oe 


| #0) & = S06 = 0). (7) 


i 


This formula does not contain anything that is essentially new: if we 
denote by F(x) a primitive’ of the function f(x), then formula (7) can 
be written in the fon years 


F(b) — F(a) = F' (e)(b — a); 


existence of the point c(a < ¢ < 6) which will satisfy this relation can 
simply be proved by applying Lagrange’s theorem (§ 36) to the function 
F (x) in the interval (a, 6). The above deduction from formula (7) is 
inieresting insofar as the relationship between an integral and a 
primitive is not used. 


The ‘‘mean value theorem” expressed by formula (7) can be 
generalised. Let the function ? (x) be continuous and keep the same 


sign in the interval (a, 6); we shall assume, say, that it is not negative. 
then fora < x < b we have 


m? (x) < f(x) ? (x) < MP (x), / 
and therefore it follows from theorems 4 and 2 $49 that 
b b b 
i m | @(a)de <[ fla)? (0) de <M | ©) ds 
a a 


a 


or 


b 
[ £6) 0) ax 








b 


| (x) dx 


As’ before, we can therefore conclude that a point ¢ exists 
between a and 6 for which red 


[fe eG) de 
on 


ne ae [ew dx 
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or 
b , b 
[70 20) a = flo [ 0) ae (9) 


a 
Theorem (Mean value theorem). Jf the functions f(x) and 9 (x) 


are continuous tn the tnterval (a, 6) and if (x) keeps the same sign, then a 
potnt c can be found between a and b for which the relation (9) holds. 


We find in practice that this theorem is not as useful as the 
inequalities (8) which lead us to it. 
Note. In the proof of formula (9) we divide by the integral 
b 
| ? (x) dx, 


a 


and therefore assume that it is not equal to zero. Butif the function 
(x) is identically zero in the interval (a, 4), then the relation 
(9) is trivially true (for every c). If, however, ¢(«) > 0 only for one 
value of «(a < a < 4), then it follows from continuity of the function 
? (x) that it is also positive in the neighbourhood (« —¢, «+ ¢) of the 
point « (lemma §23). If M > 0 denotes the lowest value of the 
function (x) in the subinterval (# — ¢,« + €), then (corollary of 
theorem 2 § 49) 


b ate 
fe@dr> [e@)dr>ul@+y—G@—o]=2ue>0. 


a a@&—eE 


5. In practical applications one simple corollary of theorem 2 
849 is often very useful. We evidently always have 


— | f(x) | < f(x) <1 fl) | 


it therefore follows from this theorem that if the function f(x) is integ- 
rable in the interval (a, 4)*), then 


b b b 
- fis@ian < [sax < fire las 


*) The integrability of | f(x) | is proved in 848 (theorem 2), 
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or, which is the same 


in ds | < fist | as, 


The absolute value of the tntegral does not exceed the tntegral of the 
absolute value of the integrand. 


This important inequality is analogous to the inequality in 
elementary algebra according to which the absolute value of a sum 
of several numbers never exceeds the sum of their absolute values. 


CHAPTER XIV, 


fy ® : 2k SPN x 


| GEOMETRICAL AND. MECHANICAL APPLICATIONS - 
" OF INTEGRALS °° ° 


§ 52. Length of an are of a plane curve 


Apart from calculating areas of plane surfaces, calculation of 
the lengths of arcs of plane curves is one of the most important 


geometrical problems solved by 
means of integral calculus. Impor- 
tance of this problem is so great 
from a practical point of view that 
no further explanations are needed. 
In this case, as with areas, elemen- 
tary geometry enables us to cal- 
culate only the lengths of straight 
lines and circular arcs, but a general 
solution is only possible with the 
hoe help of methods of mathematical 
Fig. 36. analysis. In this case the logical 
situation again assumes its familiar 
aspect : we must define simultaneously the general concept of 
length of an arc and find an apparatus for the practical evaluation 
of this length. 





Ae 





We shall try to solve this problem by a method which resembles 
even more closely than that used for calculating areas to the methods 
by which lengths of circumferences and arcs are calculated in 
elementary geometry. Let us assume that the given curve represents 
the graph of the function y = f(x) and that we wish to find the 
length MN of this curve (Fig. 36) between the points M[a, f(a)] and 
N[é, f(6)].. As in other problems of this type we begin with an 
arbitrary division 7 of the interval (a, b) by means of the following 
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points of division : a = x) < x <<... <x, = 6. From every point 
of division we draw a perpendicular to the OX-axis and produce it 
to intersect the curve» = f (x). The arc MN of this curve is thus 
divided into n sections.‘ Let us now connect each’ pair ‘of adjacent 
points of division of the section MN by a rectilinear chord. -The set 
of these chords forms a broken line inscribed in the arc MN. The 


length of this broken line can abviously be calculated. . 


If we now make the division T as finé as possible, then the 
constructed broken line will evidently adjoin the arc MN more and 
more closely. Therefore as in the case of circumference, it-seems 
obvious to define length of the arc MN as limit of the length of the 
broken line as the division'T tends to become indefinitely fine. It is, of course, 
essential that this limit should exist and that it should be- independent 
of the-chosen system of division T. This definition solves the first 
part of our problem. 


The length of our constructed broken line evidently depends on 
the division T of the interval (a, 6); we can therefore denote it by 
KT). If we denote the ‘required length of the arc ss by = ee 
in accordance with our definition, we have : 

L=im (7), 
U(T)30 

where [(7) has its usual meaning (the length of the longest sub- 
interval of the given division). In order to obtain a method for 
evaluation of Z on the basis of this definition it is at first mecessary’to 
find an analytical expression for the length L(T) of the constructed 
broken line. This can readily be done. Two adjacent points of 
‘division of the arc MN have the following co-ordinates: [x,-1, f (*x-1)] 
and [x;, f(x,)]; therefore the length of the link in-our chain connect- 
ang these two points. is 


V (xu — Kae)? + Te (xx) — f (x ml, 


and consequently 








LID) = VV Ge — seal? + OF ee) — FF. 
k=1 
‘Let us now assume that the function f (x) has a continuous deri- 
vative f’ (x) in the interval (a, 6). It then follows’ frorm*Lagrange’s 
theorem that 


Ce ee ee eee 
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where 
Kya < Ex << me (IL Sk <a). 


Therefore assuming further that x, — x71 = Ax (1 Qk <n) 
we have : 





Since it is given that the function { (x) is continuous, therefore the 
function 


STEP TR = $e) 


is also continuous and we have : 


L(T)= )\¥ Ex) Ar 
k=1 


But we know that if / (J) > 0, then irreepeéctive of the chosen divi- 
sion and the position of the points € , in the subintervals the follow- 
ing integral has as its limit 


4 5 b 
fomanf[yvisyrta asl yrey? a 
‘a a a 
We therefore have : 


b b 
b= [vityta=[VTEFFG de (1) 





which fully solves our problem by replacing evaluation of the length 
L of the arc MN by evaluation of an integral whose integrand is 
known to us. 


Example 1. The catenary 
ef te 
2 


has the form shown in Fig. 37. Let us find the ength Z of the arc 
of this curve between x = QOand x = a> 0. We know that 





y = cosh x= 


e” =. ee 


y’ =sinhx =- 5 ; 
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and therefore 
Vil+y? = V 1+ sinh?x = cosh x 


(this elementary calculation shows that cosh? x — sinh? x = 1 for any 
x). Therefore the general formula (1) gives : 
a 


la et — e~% 


a 
L= [v 1+y? dx= [eosn x Bee =sinh a = aaa mea 
0 0 


and our problem is solved. 


We have so for assumed that the curve is given by an equation 
of the type y = f (x). This means geometrically that every straight 
line parallel to the OY-axis intersects the section MN of the given 
curve at one point only. This condition may often prove to be res-- 
trictive and in some cases it may be impossible to satisfy it for any 
choice of coordinates — for example, when we are calculating the 
length of a closed curve. In such cases it is much more convenient 
to use the more general parametric representation of a curve by 
means of two equations of the type 


x= ?(), y= H(t), (2): 
where the parameter ¢ runs through a section « <t < # while the- 
point (x, y) describes the section of the curve in which we are interes-- 


ted and which, in this case, can be of 
an arbitrary shape ; thus if 


x=rcost, y=rsint, 
0<i<2zx (r>0), 


then the point (x, y) describes a full 
circle 





x? + — 2 


Fig. 37. 


of radius r. 


We shall now try to find an expression for the length of the arc. 
of the given curve when this curve is expressed as parametric equa-- 
tions of the type (2). For this purpose we subject the interval (a, 8), 
along which the parameter varies, to a division J with the following: 
points of division: « =ig<ty<.-»<t,= 8. The link of the broken 
line which corresponds to the section Az = ty — t,-4 of this division 
evidently has the following length 


V [? (tn) — ? (tea)? + [b(te) — ¥ (trad ¥- 
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Assuming that the functions ? (t) and wv (¢) have continuous deriva- 
tives in the interval («, 8),.we have according to Lagrange’s theorem : 


P (tx) — 9 (te-1) = 9! ue An (tea <7 < ti), 
(tx) — ¥ (E%-1) wt ) An (fxr < Ve <&), 


and therefore the length of the broken line which corresponds to the 
division 7 is 


n 
= Vivo? +07 (70) At. 
k=1 
If the same value of the parameter ¢ (for example T x) stands 


‘under the symbols 9" and ’?, then for / (T) + 0 *) the sum on the 
right-hand side tends, as we row. to the integral . 


BL 
L= [v oe (t) + y(t) db. | . @ 


In fact, however, t,’ need not coincide with t, and this creates diffi- 
‘culty in the limiting process which we must overcome. Let usassume 
-for the sake of brevity that 


VPP) FUE =P VOM FUT IRe) be 


so that 


- n n n 
; L(T)= » eo’, Ar = » P,rARH+ A (2%r — Pr Ak 
kel k=1 k=1 


The first sum on the right-hand side tends to the integral (3) as 
its limit for / (T) —> 0. Hence in order to show that this integral is 
also limit of L (T) it is sufficient to prove that the last sum on the 
right-hand side tends to zero for 1 (7) > 0. We shall do so now. 


It 9’ (tz) = 0, then 9, =14' (te) |-e's = |$' (e's) | and 
‘therefore . ? 
. fee erl< 19) —O' aI 
If, however, ? a = 0, then P, > 0,9’, > 0, and 
o'n — PP = Yb" ( —ye (TH=LP’ (tb (re) Lb! TY ‘Gal 


*) 1 (T) acute, as usual, the longest subinterval A, of the division T. 
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and consequently 


ri |= Gi x) tY'(te) 


ee Pat Px 





LOE) —o! (me) | <P U(r) —U'(me) 


so that evidently 





pe ey) AY ley) 
| ee ee a 


We therefore have in each case : 
1P’~e — ee{ <[b' ',) — V(r), 


and therefore, - 


n n 
\Y @r—edasl[< Ply Go Gy) lA &) 
k=] k=l 
But in accordance with our assumption the function vy’ ( (t) is 
‘continuous and therefore also uniformly continuous in the interval 
(a, 6). Ife > 0 is as small as we please, then evidently 


[eGR — be Gal <e (lL <k <n), (5) 


provided / (T) is sufficiently small. But it then follows from (4) and 
(5) that 


Ee “e - Pr) par |<e Barrer. 
ke k=1, ae 
This proves that for / (T) > O° . a 
n 
y (e's cae ex) Ax ae 0, 
k=1 : 
.and therefore 


to 


L(T) foe | WEIO) + 2 (t) dt. 


Hence if the curve is given in parametric from the length of the 
arc corresponding to: the interval « <¢<§ of the parameter is 
evaluated by means of the integral (3). It is evident that this 
_antegral assumes the familar form (1) for #'= x. 
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Example 2. Find the length of the cycloid (Fig. 38) 
x = a(t — sin?), y = a (1 — cos?) 
in the interval O <i <27. 
We have (denoting differentiation with respect to. by dashes) = 
x = a(l — cost), »’ =asin#, 


and consequently 


x’? +. y’? = 2a?(1—cost) = 4a? sin? > 
Ve Ey? = 2a sins 5 
hence 
an Tt bd 
L = | 22 sin dt = 2a [2 sin u du = 4a( — cos u)| = 8a. 
0 0 0 


For further exercises ¢f Problem Book by B.P. Demidovich,. 
Section IV, Nos. 209, 220. 


If instead of considering the interval («, 8) we consider the 
subinterval («, ¢), where / varies from « to 8, then the length of the 
arc of the curve in the subinterval (a, 2) will be a function of ¢: 





t 
L= LQ) = [Ver + VW du 


(as usual, in such cases we no longer denote the variable of integration: 
by ¢ but by any other letter, for example z). 


Hence 





dL = Vdx* + dy?. (6): 
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fn the case when t = x, y = f(x), we have similarly 


x 
Ps Ee [vi + F's) dx, 


L'(s) = VIFF R= vitvt= A/ 14 (BY. 


Formula (6) which is independent of the choice of the para- 
meter ¢ shows that the differential of the length of the arc is equal to 
the hypotenuse of a triangle in which the sides adjacent to the right 
angle are equal to the differentials of 
the coordinates of the points of the 
given curve. Therefore when t = x, 
the differential of the arc of the 
curve in transition from the point 





Oo na . éno X 
Fig. 38. Fig. 39. 


M(x, y) to the point N(x + Ax,» + A_y) (Fig. 39) is expressed in 
terms of the length MT of the section of the tangent at the point M 
to the given curve between the straight lines parallel to OY, which 
have the abscissae x and « + Ax respectively. 


Any curve which is expressed in the given interval by equations 
of the type (2) and has a definite length, i.e. for which the limit 


L = lim L(T) 
u(T)-0 


exists in the sense in which we have often described it, is said to be 
rectified in the given interval. It evidently follows from what is said 
above that every section of the circle (2) can be rectified provided 
the functions ? (¢) and {(¢) have continuous derivatives in this section. 
Such a curve can evidently be rectified also in any subinterva 
(a, t)(a < 4 < 8) of the interval («, 8)-and its length in this suinterval 
is a continuous increasing function of ¢; therefore, conversely, a defi- 
nite value of the parameter ¢ corresponds to every value of L(¢); this 
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follows from equation (2)’and difinition of a point on the given curve.: 
In this case ¢, and therefore also x and », are continuous functions of 
L(t). For such a curve we canchoosea length A ofa section of this curve 
as the parameter determining its points from a certain point onwards. 
which is once and for allaccepted as the origin for every other point 
on the curve. A definite point (x, y) on the curve corresponds to each 
value of A such that the coordinates x and y.of the points on the curve 
become continuous functions of A: 


x= fi (), y= fold); (7) 


this is evidently the parametric equation of a curve which is a 
particular case of the general form (2). In many cases the form (7) is: 
particularly convenient owing to the simple geometrical meaning of 
parameterA. Thus, for example, both derivatives 


Fx (A) _ & and f',(A) = a ; 


se k 
of the coordinates with respect to the parameter A have, in this case, 
a simple geometrical meaning: If we assume that L =A, then it 
follows.froam the relation (6) that: 


dx de 8 > ao ao 4 x 7 i 

NW de tae Vit yt? ON Vat tae VIF 5’ 
whee y’ = dldx. Tf « is the angle formed by the tangent to the 
given curve at the given point and the positive direction of the OX; 


axis, then y’ = tan and therefore es 
ax re ax . 
— = cos — = sin a, 
dn TIN ee 


These relations can be seen directly from Fig. 39. 


The established definition for ‘rectification of a given section 
of the curve and also the. expression (3) for the Jength of this section 
evidently depend on the choice of the parameter ¢ ‘in the initial 
equations (2). These concepts’ can ‘also have a purely geometrical 
definition which is quite independent of the analytical representation 
of the. given curve. On the other hand it can be shown that, 
provided some additional conditions are satisfied, the length of the 
curve (2) also becomes independent’ of the choice of the parameter’ is 
However,, within the” ‘scope or “this course we GAnNGt ee into these 
details. ‘ : 


Pave i ae ae 
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We have learnt above that every curve which can be expressed 
by- an equation of the type (2) can be rectified. in the given interval’ 
(«, 8), provided the functions ¢ (t) and ¢(t) have continuous derivatives: 
in this interval. In practice one frequently meets the case when such: 
an assumption cannot be made with regard to the curve but when 
the interval («, 8) can nevertheless be divided’ into a finite number 
of subintervals, in each of which this assumption can be made 
(for example the contour of a polygon). In future we shall agree to: 
call such a curve smooth in the interval («, 8)*). 


It can readily be shown that every smooth curve can be rectified. 
In order to prove this, let us assume for the sake of simplicity that 
one “singularity” always exists, which corresponds to the value t of” 
the parameter ¢ (the general case evidently creates no other difficul- 
ties), so that it is known, to begin with, that the given curve can be 
rectified-in each of the subintervals («, t) and (t, 8); let its lengths’ 
along these sections be equal to L, and L, respectively. « Let T be an 
arbitrary division of the interval («, 8) and 7’ a division resulting 
from the division T when the point t is added as a point of division: 
In that case the broken line 4’ which corresponds to the division T* 
‘consists of two broken lines 4’; and 4’, which respectively corres- 
pond to the divisions of the subintervals («, +) and (+, 8); since the 
curve can be rectified in these subintervals, the lengths of the broken 
lines 4’, and 4’, are correspondingly close to L, and Ls, provided 
the division. is sufficiently fine, and therefore the length of the broken 
line A’ is close to L44L,. - But the length of the broken line 4 which 
corresponds to the division Z. differs from the length of the broken 
line 4’ only insofar as the sum of two terms of the latter, which 
can be as small as we please, is replaced by a single term, 2.¢. the two 
sums differ from one another by .as little-as we please. Hence the 
length of the broken line 4 differs by as little as we please from the 
length of the broken line 4’ which, in its turn, is very close to Ly4Z., 
provided. the division is sufficiently fine-- But this means that the 
given curve can be rectified in the interval (a; Bi - ‘and ‘its length is. 
equal to Ly44Lp. 





*) This is evidently equivalent to the case when the curve can be expressed’ 
by equations of the type.(2) in the interval («, 8), where 9(¢) and W(t) are conti- 
nuous everywhere while 9’(#) and ’(#) exist and are continuous everywhere 
except at a finite number of points ; at each of these “‘singularities” the function 9(¢) 
(as well as the ()) has a derivative to 1] the right | as well as to the left, but these- 
derivatives may have different values, seh 
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Integrals can be evaluated along curves which can be rectified 
(and, in particular, along smooth curves) in the same way as along 
straight lines. Let it be given that the given rectified curve is 
expressed by the equations (7), where the functions f; and fe are 
assumed to be continuous. Let us take as origin one of the ends of 
the section of the given curve in which we are interested and denote 
by LZ the length of this section, so that the parameter A varies from 
‘Oto L along its length. Let us divide the interval (O, L) into 
subintervals by means of the following points of division 


O=A<A<. <= L, 


and denote the subinterval (A,-), Ax) (I< k < n) as well as thelength 
of this subinterval by /,. 


Let F(x, y) be a function of two variables defined at all points 
of the given section of the curve. Select an arbitrary point 
A¥, (Ana << A*, < Ay) and assume that x, = fy (A*z), yx = fo (A*2), 
so that (x;,,_y,) isan arbitrary point on that section of the given curve 
‘which corresponds to the subinterval J, along which the parameter 
‘A varies. Let us construct the sum 


nh n 
Y) Flin ade = YEA OSs OMe 
k=1 k=1 
If the function F[f, (A), fe (A) ] is integrable*) in the interval 
(QO, L), then the sum on the right-hand side of the last equation has 


ithe following integral as its limit, provided the division becomes 


indefinitely fine : 
; L 


[ FUL S21 a 
Q 


By denoting the whole interval (O, L) of the given curve by C, this - 
integral can be written in the form 


| F (x, y) da 
Cc 


.and is said to be an integral of the function F (x, y) along the curve C. 





*) This will always be so if F (x, y) is continuous at all points on the given 


curve (cf. also §88) so that F[ fy (A), £2 (A) ] is a continuous function of 4 in the 
terval (0, L). 
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a 


Integrals taken along smooth curves occur frequently in 
practical applications. As simpler typical examples of this kind we 
shall consider in §54 problems connected with mechanical character- 
istics of plane curves. 


§ §3. Lengths of arcs of curves in space 


Evaluation of the lengths of curves in space is so similar to what 
has been said in the previous paragraph in connection with plane 
curves that we can restrict ourselves to giving the fundamental 
definitions and results only. 


1°. If the section AB of the given curve can be expressed by 
the equations 


y=fil¥), 2=felx) (@<% <3) 


and if the functions f; (x) and f, (x) have continuous derivatives in 
the interval (a, 5), then the section AB has a definite length which is 
equal to 


5 


b 
ba[ viet Fete = [VIFF P+ Feo de 
a a 

2°. In general, if the section AB of the given curve can be 
expressed by the following parametric equations 


401), y = ¥(8), Z= x(t) (x <t<68), (2) 


where the function 9 (é), }(é), x (f) have continuous derivatives in 
the interval (a, 6), then the section AB has a definite length which is 
equal to 


8 
L=|ve®@ FeO +77 Ou. (3) 


3°, If we denote by L(é) the length of the section AB of the 
curve in the condition 2°, which corresponds to the subinterval («, £) 
‘of variation of the parameter (« < ¢ < 8), then 





Li) = VF?) 407) 4 70) 
and 


dL = Vdx' + ay + d2. 
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In particular, when we have the conditions 1° 





Ligh=V b+y%4+ 22 = VI+A? (4) + f(x). 
4°. The curve (2) which has a definite Jength along the section 
AB can be rectified along that section. If the section AB of a conti- 
nuous curve can be divided into a finite number of parts, along each 
of which the curve satisfies the conditions 2°, then the curve is said 
to be smooth along that section. Every smooth curve can be rectified. 


5°. A curve which can be rectified can be expressed by equa- 
tions of the form 


x= @ (A), 9 = $ (A), 2=% A), (4) 
where A is the length of the curve from a fixed origin to the point 
(x, », Z). In this case 


dx 


TN = ?'(A) = cos a, = 2 = ~'(A) = cos B, omy ‘(A)=cos Y, 


where «, 8, Y are angles between the positive direction of the axes of 
coordinates and the tangent to the given curve at the point (x, y, 2) 
drawn in the direction of increasing values of A. 
6°. Ifa curve which can be rectified is given by an equation 

of the type (4) and the function F(x, y, z) is continuous along the 
section C (Ay <A <A,) of the curve, then the integral 

Ag 

[ F (00, 9), 20)] 4a 


AY 
is said to be ‘‘the integral of the function F (x, y, z) along the curve 
C”’ and it denotes 


| F (x,y, z) da, 
Cc 


§ 54. Mass, centre of gravity and moments of inertia of 
a material plane curve 


1. We consider a section C of a smooth plane curve given by 
the following equations : 


«= 9(A),7 =A), (1) 


where A is the length of. the arc of the curve taken from the beginning 
of the given section so that when the point (x, y) runs along the 
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section C, A increases from 0 to a number L which represents the 
length of the whole section under consideration. For the sake of 
brevity we shall in future denote the ‘point A” of the given curve 
as the point (x, ») which corresponds to the given value of A. 


We assume that a mass is distributed along the given section of 
the curve (‘“‘material curve’). Let M(A) dencte the mass distributed 
between the points 0 and A on the given curve and let the function 
MM (Xx) have a continuous derivative M’ (A) = 9 (A) in the interval 
(0, L). While considering a rectilinear section in § 27, we have agreed 
that ¢ (A) should be called density of the mass at the point A on the 
given curve. The arguments which we used at the time in support 
of this terminology also remain valid in the general case (if, as we 
assume, the curve is smooth). Formerly we had to restrict ourselves 
to rectilinear sections only, because at that time we were not acquaint: 
ed with the general concept of the length of an arc. 


Hence we shall call the quantity p (A) density of the mass at the 
point A on the given curve. Since e (A) = M’(A), therefore, 
conversely 


rN 


M (A) = [ ew du 
0 


(the lower limit of integration is so chosen that M(0) = 0). If we 
want to determine the mass 


M (Ay, Ae) (O <A < AQ < L) 
in the subinterval (A;, A,) of our curve, we find that 


ro 


MQ, %)) = MQ) — Mr) =| 0 (w) du= J ols yaa. (2) 
C 


ry 


This formula expresses the mass of an arbitrary section of a 
material smooth curve which is at every point given in terms of the 
density e(A) of the mass. 


2. If we have a system of a finite number x of material points 
situated in one plane, whose masses are respectively m, m,..., mp 
and their coordinates (x4, 91)) (2s J2)> «+ +5 (¥n» Jn), then the coordi- 
nates of the centre of gravity of this system are, as we know, 
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n n 


UT MpX x Z MEY k 
ed a ca Oo (3)- 
~~ Rn ? : ome” i ; 
x my =m, 
k=1 k=1 


n 
or, denoting by M = y} m;, the mass of the whole system, 
k=1 


Let us now assume that the mass is not centred at individual 
points but is continuously distributed along the interval (0, L) of the 
smooth curve (1). We shall try to give a comprehensive definition 
of the centre of gravity of such a system and find a method for 
evaluating its coordinates. 


Let us divide the interval (0, Z) into arbitrary parts {‘‘subinter- 
vals’?) by means of the following points of division 


O=AVQ<AV< ee SAAS L (T) 


and assume, for the sake of brevity, that A, —Ap-y7 = Ax (1 Ck <n). 
Let the density of the mass at the point A on our curve be equal to 
e(A) (0 <A <L); we assume, as before, that the function op (A) is 
continuous along that interval. According to formula (2) the- mass 
of the subinterval A; is equal to 
Ak 
my, = | ep (A) da, 


AR-1 
and it follows from the mean value theorem (§ 51) that 
mM,y=oO (A*;) Ary 


where A*;, is a point in the subinterval A,. If the subinterval A,, is 
very small, we can imagine it to be a material point of mass m, situ- 
ated at the point A*, on our curve. If we perform this replacement 
along every subinterval of the division (7), then our material curve 
will, as an approximation measure, be replaced by a system consist- 
ing of n ‘material points; the masses and the coordinates of these 
points will respectively be equal to 


my, = e(A*,) An ¥e = 9 (A*,), pe = (A*,) (LSA <n), 
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and it follows from formula (3) that the coordinates of the centre of 
gravity of this system will therefore be 





n n 
— P(A") 2 (A*;,) Ar _ = e(A*;,) b (A*,) Ax 
6 0 tee Fa Sr re 
= eA* Ay = p(A*;,) Ax 
k=] : k=l 


As the division (7) becomes indefinitely fine, the constructed 
fictitious system consisting of a finite number of material points 
resembles more and more closely our material curve. We therefore 
naturally assume that the coordinates (x, y) of the centre of gravity 
of the given material curve will be respectively equal to the limits of 
the number x (7) and y (7), provided the division (J) becomes in- 
definitely fine. This evidently gives 


L 
feemar — [xotasaa 
— 0 C 
x Laaaeae L ee a Kemet mae > 
Je (A) da [ ees) dy 
0 Cc 
i 
Jecremd forrGra 
pe Cc 
y =} Seated “2, ae (4) 
[evan Jeo a 
0 Cc 
or, denoting by 
L 
M= | e (A) dA 
0 
the mass of the whole given interval, 
L 
S=/lenhienn< al * (x, y) da 
x= M p 2 a M Px, 3 
0 C 


L 
T= Jef oO) a= Z| rele 9) O 
0 Cc 
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If our interval is physically Aomogeneous, i.e. if p(A) =p 18 a 
constant along its length, then the formulae (4) give : 


L L 

eee. —l fin vee =| A 5 

=| e(ndr—=s- [adr Fa | ¥QldA= L yd . ( ) 
0 Cc 0 Cc 


Let us again return to the mechanical system which consists of 
a finite number of material points. Let m1, me, ..., Mn denote the 
masses at these points and 7), ray... .. ,#n their distances from an arbi- 
trary axis (or from a definite point). The sum 


n 
k= Y) mars 
k=1 


is called moment of inertia of the given system with respect to the given 
axis (or point). Ifthe points of our system are situated in one plane 
and have rectangular coordinates (x1, 74), (9, Va), see mere er 
then moments of inertia with respect to the OX-axis, the OY-axis 
and the origin O are respectively equal to 


n n n 


K,z= yb Mr ny Ry = Y) mx? ny Ko = > my (x? 4 + yx) 
k=1 k=1 k=] 


Let us now assuine that instead of having a’ system composed 
of a finite number of material points we have a material section of 
the curve (1) which we have considered above. 


Maintaining all previous notations and repeating all arguments 
with whose help we obtained a definition for the coordinates of the 
centre of gravity of such a section, we readily obtain the following 
natural definitions for its moments of inertia with respect to the 
OX-axis, OY-axis and the point O: 


L 
K.= | e@eaydr= | ro (x, 9) ar, (6} 
0 G 


L 

Ky = [oa etayara | xo, 9a 
0 Cc ; 
L 


B= | (A) [02 (A) +92 (A)] dA = | (2 + 9) 9 (xs 9) A. 
0 C 
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Example. Let us find the coordinates of centre of gravity of 
a homogeneous semicircle x? + 9? = a® (y > 0) and also moments of 
interia of this semicircle with respect to the diameter joining its ends. 
In view of symmetry it is evident that x = 0; therefore we have only 
to find y and K;. Denoting by A the length of the arc of the semi- 
circle as counted from one of its ends we can write the equations of 
this curve in the form 


A . A 
x = acos-——, y = asin — (0 <A < za). 
a 


It therefore follows from formula (5) that 


Ta 


A 2 
pita asin-——dA= —a. 
ma a rc 


On the other hand, formula (6) gives: 


$ 55. Capacities of geometrical bodies 


As a rule, evaluation of capacities of geometrical bodies requires 
more complicated analytical methods than those which we have learnt 
to use so far. We shall consider this 
problem in detail later (Chapter 27). 
However, many problems can be com- 
pletely solved with the help of simple 
integration and we shall now consider 
such problems. 


Let us assume that we want to cal- 
culate volume of the body represented in 
Fig 40. Let us select an arbitrary rect- 
angular system of coordinates OXYZ in 
space and let us agree to call the coordi- Fig. 40. 
nate z as “‘height”’ of the point (above the 
plane XOY). The plane z = A (where h is a given arbitrary real 
number) generally intersects our body forming a definite plane figure. 
We shall assume that area of this “section” is known to us (of 
we can evaluate it in one way or the other) for every value of A: 
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This area will in general be different for different values of 4 ; it isa 
function of 4 which we shall denote by s(f). The special class of 
problems which we shall now consider is characterised by the fact 
that the function s (4) (the area of the cross-section of the body at the 
height 4) is assumed to be given and it is necessary to use it for 
‘expressing the volume V of the given body. 


Let us at first assume that the given body is a right cylinder, 1.¢. 
all its horizontal sections when projected onto the XOY-plane result 
in the same figure (Fig. 41). If this figure is a circle, then we are 
dealing with a right circular cylinder whose volume, as we know from 
elementary geometry, is equal to the product of area of the base and 
height. We shall naturally try to adapt this rule to apply to the 
general case when the base of the cylinder is of an arbitrary shape *).° 

We therefore accept that volume of any body in the shape of a 
right cylinder is equal to product of the area of the base of this 
cylinder and its height.**) 


Let us now consider the general case (Fig. 40). Let the lowest 
point of the body be situated at the height a and the highest point at 
the point 5. Let us divide the interval (a, b) 
arbitrarily into several parts (subintervals) by 
means of the following points of division : 


a=h<h<hp<.w <hyp= db (T) 
and let us select ineach subinterval 
(hei, Ae) = Ax 
an arbitrary point z; such that 


Ay-y S Zn Sm (Q<k <n). 





Fig. 41. The family of planes z=, (k=O, 1,..., n) 

divides the given body into horizontal “layers” 

whose thicknesses are equal to Ay, =A, — hy-1 of the corresponding 
subinterval. If this value is very small, then the volume v, of the k-th 
layer will be approximately equal to the volume of a right cylinder 


*) From a logical point of view we evidently find ourselves again in the usual 
situation : the concept of volume of a body, except for a few cases considered in 
elementary geometry, has not yet been defined and it is our first duty to give a com- 
prehensive general definition. 

**) This assumption is analogous to the assumptions made earlier in connec- 
tion with velocity of uniform motion, work done by a constant force, etc., when We 
were solving the respective problems. * 


‘GEOMETRICAL AND MATHEMATICAL 249 


-of height A, whose base is equal to one of the sections of the body 
within this layer, e.g. to the section of the body at the height z,. 
Since area of this section is equal to s (z;), the volume of this right 

-cylinder is equal to s(z,%) Ax; hence we can assume approximately 
that 


Ue ZS (Ze) Ans 


and consequently 


i R 
V= Yazy 5(2x) Ax 
k=1 k=] 


these approximate equations will naturally be more accurate as the 
-division (J) becomes finer; we therefore assume as usual that by 
definition 


V = jim S (z x) Ar 
l(T)—>0 


provided, of course, the above limit exists and is independent of the 

- chosen system of division and choice of the points z; along the sections. 
But, as we know, this always holds, provided the function s (A) is con- 
tinuous in the interval (a, 6); therefore in this case 


d 
V= [ sw a. (1) 


a 


“This formula solves our probiem and defines the general concept of 
volume of a body witl the given cross-sectional areas ; it also gives a 
definite method for evaluating this volume. 


Example 1. Let the ‘given body be a pyramid of height H, 
‘whose base is an arbitrary polygon of area S. We know from ele- 
mentary geometry that the cross-section of this pyramid at the height 
. kh represents a polygon similar to the base whose area is proportional 
to the square of the distance of this section from the vertex of the 
_ pyramid, 7.e. proportional to (H—A)?. 


We therefore have in this case : 


s(h) = k (H — hj’, 
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where & is a constant which can readily be found from the condition 


£(0) = 8% 


S=skH*, k= —, 
and therefore 
: S ee As? 
s(t) = Fa (H— Wt = 8 (1- F)- 


Formula (1) gives us the following expression for volume of the- 
pyramid 


1 hy? 
ves (1 - +) dh. 
0 


The substitution 1 — h/ H = u gives 


V= s[eni 5 a SS, 
We can thus see how easy it is to obtain with the help of integral 
calculus the formula which can otherwise be deduced with much 
greater difficulty by using the methods of ele- 
mentary geometry. All arguments and results - 
remain fully valid if the base is not a polygon 
but any plane figureof area S. In particular, 
for a cone of height H, whose base is a circle of © 
radius R, we have the following known formula 








7tR°H 
Va Te 
Fig. 42. Example 2. Let the given body be a 


sphere of radius R, the heights h of whose cross- - 
sectional areas are measured by their distance from the equatorial 
plane (Fig. 42). It can be seen from the diagram that the radius r- 
of the section at the height / is equal to 
raf R- he, 
therefore the cross-sectional area is 


S(h) = nr? = 2 (R? — fh), 


GEOMETRICAL AND MATHEMATICAL 251 


and the volume of this sphere as obtained from formula (1) is 
R R R 
V= [> (R?—h?) d—n R* | dh —7 | dh = : a R3, 
—R —R —R 


Example 3. Let the section a < x < 6 of the curve »y =f x) 
revolve about the OX-axis *) ; let us find the volume V of the body 
obtained as a result of this revolution (Fig. 43). Al cross-sections of 
this body which are perpendicular tothe OX-axis are evidently circles. 
A section by the plane x = A(a <A < bj has, in this case, a radius. 
equal to f(A) and therefore its area is equal to x[f(h)]?. We therefore 
obtain from formula (1) : 

& 


cos juror dh. 


Let us also consider evaluation of the surface of the body result- 
ing from the revolution described in example 3 ; we must remember 
that we have so far not defined the general concept of the surface of a 
curved figure, and we must therefore begin by giving this definition 
(at least for bodies resulting from revolution). For this purpose let 
us perform the usual division 7 of the interval (a, 6) with the help of 
the following points of division " 


DK he Sed Sh SS BP, 


which corresponds to the division of the given section of the curve into: 
n parts by means of the points [ x«,, f(x,)] (k = 0,1, ..,m). Join 
each pair of adjacent points of division [x;-1, f(« r-1)], [ (xe, f(*x)I- 
by a rectilinear chord whose length is equal to 


Ips V (ee — ®n-a)® + OF x) - Slew? 

As the broken line formed by this chord revolves about thc OX-axis, 
the area S$* of the surface resulting from this revolution can be re- 
garded as approximately equal to the required area S of the surface 
resulting from the revolution of the given section of the curve. It is 
obvious that §* will be closer to S as the division 7 becomes finer ; 


we therefore assume that 





S = lim S* 
1(T) +0 


and proceed to find an analytical exprcssion for S. 





*) We assume, for the sake of simplicity, that f (x) > O(a<x< d)- 
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We note in this connection that if the chord 1, revolves about 
the OX-axis, it describes a cut cone (Fig. 44) whose generating line 





Fig. 43. Fig. 44, 


‘is equal to /, and radii of the bases /(x,-) and _f(x,) respectively. 
“The side surface of this cut cone is equal to 


Sy = TUS aa) +f (xed) le 


-Let us assume that the function {(x) has a continuous derivative in the 
anterval (a, 6). It then follows from Lagrange’s theorem that 


S (x) — Sf (% x-1) =f’ (Ex) (te — Xn-t)s 


~where «;-1 < &, < *,; therefore if we assume, as usual, for the sake 
‘of brevity, that x, — xp-1 = A, (1 <k <n), we obtain: 


p= VI +f (En) Aw 
-and therefore 
Sp=r[fleea) + fled) V1 +f’? (Ex) Ans 
thence 


n 


SF ee yisy =T VU ed) + fle) V1 +7? (Ex) An= 
k=] k=] 


=e Vf) V1 + f?(E) An + 
k=] 


+ Vf laa) + flee) — 2fE OVI + FFE) Ad 


k=1 
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As l(T) + 0, the first term on the right-hand side tends to the limit. 


given below, since we have assumed that the function /’ (x) tends to. 
the limit 


b 
2n [re V1 +f’? (x) dx. 


Therefore if we can prove that the second term on the right-hand. 
side tends to zero for /(T) — 0, then existence of a limit for S* will. 
be established and we have : 


b 
S = lim $* = 2x | £(2) Vi +f’? (x) de. 
UT) > 0 ! 


But it follows from the uniform continuity of the function f(x): 
that no matter how small ¢ > 0 we have for every sufficiently fine: 
division T : 


Uf (xia) + flex) — 2f Ex) <e (1 <k <n), 


and consequently 


Vi fev) + flew) —2F ED VIF SPE) Ax] < 
k=1 


where L is the length of the given section. ‘This evidently proves all: 
that was required. 


If we assume, for the sake of brevity, that {(x)=y, then we can 
write the following formula for the side surface of a body resulting 
from revolution as obtained above : 


b 
$ =2n | Piao pete 
a 


For exercises in connection with § 55 cf. Problem Book by 
B. P. Demidovich, Section IV, Nos. 183-185, 192, 195, 199, 200, 228. 


CHAPTER XV 
APPROXIMATE EVALUATION OF INTEGRALS 


§ 56. Problematic setup 


We have already met various definite problems of practical im- 
‘portance, whose solution involves evaluation of integrals. We must 
now probe further into what is meant by “finding” or “‘evaluating”’ 
an integral. If we are given the integrand and limits of integration, 
then the integral takes a definite numerical value ; it is finding of 
this numerical value which represents the problematic setup. When 
the numerical value of the integral can be expressed in terms of 
-symbols generally used in mathematics (for example 5/7, 4/2, x? /4, 
sin (0.5), etc.), ‘‘finding”’ of the integral evidently implies its expres- 
sion in terms of these symbols: However, most of the real numbers 
-cannot be expressed in this final and simple symbolic way and we 
must therefore consider the possibility that our’ integral will be one 
such number. Numbers of this kind can only be approximately 
‘written, for example, in the form of decimal fractions with a definite © 
number of accurate decimal places. Therefore finding of integrals 
-evidently involves their approximate evaluation with a certain degree 
of accuracy. If, for example, we succeed in finding an instrument 
with whose help our integral can be represented as a decimal frac- 
tion with a preassigned number of accurate decimal places, we can 
say that our problem is solved in principle, for the term ‘‘evaluation” 
generally implies nothing else ; by the way, if the integral can be ex- 
pressed “‘exactly”’ by one of the symbols mentioned above, then this 
form of expression only implies a certain definite instrument for the 
approximate evaluation of integrals ; thus if we find the given integral 
-as equal to x*, this would enable us to represent (only by means of 
geometrical methods for the approximate evaluation of the number 7) 
the given integral in the form of a decimal fraction with an arbitrary 
number of correct decimal places. 
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The instrument which enables us to evaluate the given integral 
approximately with an arbitrary degree of accuracy is derived from 
the definition of an integral. We have defined an integral as limit of 
sums of definite form in a definite process (when the interval of integ- 
ration tends to become indefinitely small). By subjecting the basic 
interval to sufficiently small divisions and constructing the sums men- 
tioned above for this division, we evidently obtain an approximate 
value of the integral with an arbitrary preassigned degree of accuracy. 
Hence, in general, a comprehensive method for evaluating integrals 
is already provided by its definition. And if, besides, we are looking 
for and keep looking for other methods leading to this goal, this is 
entirely due to the fact that the direct method cannot be prac- 
tically applied to most of the cases because of its technical difficulties 
and complexities. 


We have already said that the best method for which science is 
indebted for all its practical successes in this field is the method con- 
necting the concept of integral with the concept of primitive of a 
function and we have seen in several examples how easy is to use this 
method for solving problems of integral calculus. If we can find the 
primitive F (x) of the function / (x) in interval (a, 6), then 


6 
[/0) de = FO ~ Fe. (1) 


Hence evaluation of the integral in this case involves evaluation 
of two values of some known function. What is meant by the 
“known”? function F (x)? In general, this can mean nothing but an 
instrument for finding the approximate value of this function with an 
arbitrary degree of accuracy. We have seen that in many cases this 
instrument is simple and convenient té apply and formula (1) readily 
solves our problem. What, then, is necessary to achieve success ? We 
know (§ 50) that every continuous function f(x) has a primitive. 
Hence formula (J) can, in principle, be used for evaluating an inte- 
gral of any continuous function. However, the knowledge of existence 
of the function F (x) is insufficient for this purpose : it is also necessary 
that this function should be known to us, i.e. we should be able to find 
its approximate value with an arbitrary degree of accuracy ; moreover, 
from a practical point of view it is also necessary that the method 
available for the approximate evaluation should be simple and con- 
venient, otherwise it cannot be used for practical calculations. This 
will always be the case when F (x) belongs to the class of “elementary” 


256 A COURSE OF MATHEMATICAL ANALYSIS. 


functions, since good methods for approximate evaluation are available 
for all such functions. 


However, except for a minority of cases (to which, fortunately,. 
belongs a fairly large class of functions which are very frequent in 
practice) the problem is more complicated. Differentiation of ele- 
mentary functions always results in other elementary functions; how- 
ever, the position is quite different for integration ; elementary functions. 
always have primitives (since all elementary functions are in general 
continuous), but these primitives will no longer be elementary func- 
tions. We can give many examples of simple elementary functions 
whose primitives are no longer elementary : for example the function. 


L/in«x,1/ 4/1 + x® and many others; wide classes of such functions. 
which we shall consider later, have been discovered by P, L. Ghebyshev. 
Let us assume, for example, that we want to evaluate the integral 
4 d. 
x 
= =F) - FQ), (2) 
where F (x) is primitive of the function |/In x. We must at first 
evaluate F (3).and F (2). But how can we do this if we do not know 
a convenient expression for the function F(x) and also know in ad- 
vance that F(x) cannot be expressed in its final form in terms of 
elementary functions ? Formula (2) does not obviously help us to 
evaluate the integral since all that we know about the function F (x) 
is that it is primitive of the function 1 / ln x (which we know exists) ; 
we have at our disposal no other methods except the direct or indirect 
use of the definition of an integral. 


It follows from what has been said above that integration of 
functions can serve as a new powerful means for defining and study- 
ing.other non-elementary functions. In each case when the elemen- 
tary function f (x) has no elementary primitive, its primitive 


x 


[ ft) du = Fw (3) 


a 


represents a new non-elementary function; at first we only have the 
definition (3) to help us study this function, i.e. we know nothing 
except that F(x) is primitive of the function /(x). Many functions 
which were primarily defined in. this way received outstanding im- 
portance in the course of scientific development; the properties of 
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these functions were studied in detail and tables resembling logarith- 
mic and trigonometric tables were constructed for many functions. 
This was the case with the function 





which we have considered above and which is usually dcnoted by 
Li(x) ; it is called the “intcgral logarithm’. 


If we now return to the approximate evaluation of intcgrals, we 
can see that this problem cannot always be solved by means cf pri- 
mitives, and therefore it is most important to find other methods 
which are more convenient from a practical point of view. These 
methods can be divided into two large groups: the methods of 
the first group are based on the origina] definition of an integral as 
limit of a sum and are perfected as far as possible so as to make them 
convenient for practical calculations; we shall consider in this chapter 
the simpler of these methods (which are sometimes called ‘‘mechani- 
cal quadratures’’) ; the second group contains methods based on the 
approximate substitution of the integrand by another function whose 
primitive is elementary and at the same time close to the primitive 
of the given function; these methods necessitate application of a 
much more complicated apparatus of mathematical analysis and we 
shall consider them later (section IV). 


§ 57. Method of trapeziums 


The method for the approximate evaluation of integrals, usually 
known as the ‘‘method of trapeziums’’, is well illustrated in Fig. 45, 
where we have chosen a very rough division T of the interval of 
integration (a, 5). Kectping to our usual symbols we find that arca 
of the shaded “‘leader-like” figure is evidently equal to the “lower 


ay 
. 


sum 
Nn 

5(T) = Yim Ars 
k=1 


whereas the “upper sum” 


n 
S(T) = YM Ay 
k=] 
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is equal to the area of the surrounding ‘“‘ladder-like’’ figure which is 
obtained from the shaded figure by adding the rectangles bounded 
from above by the dotted line. It is evident that for this rough 
division of the interval (a, b) both sums will differ noticeably from 


the integral 
b 


[ foes 


a 


which represents the area of a curvilinear trapezium and which we 
are trying to evaluate approximately. 


Let us join each pair of adjacent points of division of the 
portion of the curve y = f(x) by a rectilinear chord and consider the 
area S of the figure bounded from above by 
the broken line composed of these chords, 
from sides by the straight lines x = a and 
x = b and from below by the OX-axis. We 
can already see that even with our rough 
division T the area S tends to come very 
close to the area of the curvilinear trapez- 
ium which we are trying to evaluate—in 
any case it comes much closer than either 
of the two “‘ladder-like” figures considered 

Fig. 45. above. Therefore it is by far the most con- 

venient to take $ as the approximate value 

of the given integral instead of taking the upper or lower sums of the 

division T, particularly since, as we are going to show, the calcula- 

tion of S is no more complicated than the calculation of the upper or 

lower sums. We must, of course, keep in mind that Fig. 45 only 
illustrates but does not prove anything—this is so because it shows. 

only the positive part of the function f(x) which is always convex to 

the same side; however, the preferential use of S instead of the upper 

and lower sums which it illustrates remains valid in many other cases. 





As usual, let us denote by x; and A; the points and subinter- 
vals of the division 7 and assume for the sake of brevity that 


I (%%) = In CHOI ws 


Let us also assume for the sake of simplicity that f(x) > 0 (a4 < *<0). 
The sum is sum of the areas of the rectangular trapeziums situated 
above the individual subintervals A; (hence the name ‘“‘method of 
trapeziums”’); the trapezium, situated aboye the subinterval A,, has 
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height A; and bases y,-; and y,/k = 1,2,...,n) respectively ; its 
area is therefore equal to 
Jet jee re 


and therefore 


n 
l 
S==) Ger ty.) Av 
k=1 


If we want to obtain a definite degree of accuracy, we must 
naturally select a sufficiently small sub-division of T (with a sufficient- 
ly small /(7) ); otherwise the choice of points of division x; remains 
arbitrary and this fact can be used to simplify the problem as far as 
possible. Since our formula necessitates evaluation of the function 
J (x) at all points of division, we must at first analyse the points where 
the vaiues of the function f(x) will be the simplest; it may happen, 
for example, that this will be the case at all rational points or points 
which are multiples of =, etc. If there are such points, then it is 
evidently most convenient to select the points of division among 
them. If, however, the function f(x) is such that it has no preferen- 
tial points, then it is, of course, the simplest to divide the interval (a, 5) 
into n equal subintervals ; we thus have : 








Ar=2—% 9 (1 <k <n, 
and we obtain F 
n b n 
ia —a ‘ 
6 =? 5 Ve ton) = (295 2" +o) 
k= k=] 


This is the value which we accept as the approximate value of the 
given integral. It can be readily seen that formula (1) remains valid 
in the general case when nothing is given with regard to the sign of 
the function f(x). Naturally in order to assess the approximation 
given by this expression we must learn to assess the error incurred. 
We can see below how this is done. 


Replace the curve y = f(x) in an interval («, 8) (6—«a=A>0) 
by the straight chord y = /(x) which joins its ends so that I(a)=/(«), 
1(8) =f (8). We shall try to assess the difference of the integrals 
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B B B , 
| Fe) dx — | L(x) dx = [re dx os a, 


Let us assume for this purpose that 





(6) = ay nay <* <P) 


and consider the function 
@(z) =f{z) — f(z) — glx) &— a) — 8), 


where x (and therefore also g(x)) is assumed to be constant («<x«<f). 
We evidently have o(«) = 9(8) = 0; but it follows from the defini- 
tion of g(x) that (x) = 0, as we can readily see. Hence the 
function 9(z) vanishes at the points «, @ and x (« < x <°f); let us 
now assume that the function f(x) has a second continuous derivative 
in the interval («, 8) ; the function ¢(z) will evidently also have this 
property. Applying Rolle’s theorem to this function in the sub- 
intervals («, x) and (x,8) we find that 9’(z) vanishes twice in the 
interval («, 8); the second application of Rolle’s theorem (to the 
function 9’(z)) shows that the function ¢"(z) also vanishes at a point 
E in the interval (a, 8). But since /"(z) = 0, therefore 


0 = 0" (6) =f" (&) — 2g(x) 


and consequently 


Lm 
g (x) = a SF" €), 
from which it also follows that f” (&) is a continuous function of x. 


We therefore find that 


f@) IW = Fs" OHO - e), 


and this means that 


B 8 


[ fe) de — FOL ELO go | pr ee = ade — 8) te 


a a 


Since the function (* — a)(x — 8) does not change its sign in the 
interval («, 8) and f” (&) is, as we have seen above, a continuous 
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function of x, it follows from the mean-value theorem ($51) that the 
right hand side of the last equation can be written in the form 


(x= a(x — pe) dea ~ BV eG, 





care 


where & is an interior point of the interval (a, 8). We therefore find: 


fires we LO +I8) yo Mpg. 


a 


Let us now return to the subintervals (x,-1, x;) (1 <A <n). If the 
subintervals are equal, we have 


= mB = eS) = vl) wa =" SS, 
and the formula obtained by us gives 
Uk 
| f (x) dx — Meat De (6—a) =— ef (ex), 
XE-1 


where xp-1 <&4 <x (1 <A <n). Summing this equation with 
respect to k from | to n we obtain : 


where S is defined by formula (!). 


Let m and M denote respectively the smallest and greatest 
values of the function f” (x) in the interval (a,b). Then we have 
forl <k <n 


m <f" (&) <M, 


and also 


nm < ae (Ex) < aM. 
kel 


262 A COURSE OF MATHEMATICAL ANALYSIS 


Hence the quantity 


is confined between m and M and therefore a point &* can be found 
between a and 8 for which 


ee) = Py" tee, 


k=1 


and we finally obtain the following expression for the error in the 
formula of trapeziums 


b 
| f) dx — ee (Cote te Vv) Sane (6 nae (é*), 


a k=1 


We can thus see that as n increases, this error decreases in general 
as an infintely small quantity of order 1 / n’. 


For excercises to § 57 cf. Problem Book by B. P. Demidovich, 
Section IV, Nos. 272-274. 


§ 58. Method of Parabolas 


The method of trapeziums is based on the fact that the 
curve y= (x) can be replaced (or, as is usually said, interpolated) 
by a straight chord (a linear function) in small subintervals 
An = (*n-1» Xe). Itis therefore natural to try to obtain as high an 
accuracy as possible by interpolating the function y= f(x) in small 
subintervals by means of polynomials of higher degrees and prefer- 
ably by means of trinomials of the second degree 


year t Be + y, 
which can usually be represented graphically as regular parabolas. 


Let us divide the interval (a, 6) into an even number 2n of equal 
parts so that 


b— 
Ax = _ (1 <k <2n), 
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and assume, as before, that», = f(v,) (0 <k <2n). Let us take 
a pair of adjacent subintervals A 9;-, and A 2; andreplace the func- 
tion y = f(x) so obtaitled in the sub- 
interval (+ ,-2, ¥2x) by the parabola 


= ane + Bex t Ye, (1) 


which passes through the points M, ;-» 
(X24-25)'2 n-2)> Mona (2x -15 Jox-1)» Vox (Xeon, 
Ju) of the given curve (Fig 46). The 
coefficients %,, Bz, Y% can evidently be 
evaluated from this condition; we shall 
not need to do so this case. 





The method of perablas is based on the fact that in every sub- 
interval (x: ,-2, X24) (& = 1, ..., 2) the integra] of the function f(x) 
can be approximately replaced by the integral of the correspondi 
parabola (1) : 


Tor 


"ok 
[ fod dem [lent + Bax t Mi) des 
X2RA 2 *2h-2 
But in view of xy,— Xoy-2 = (Bb — a) J nand xg, = %y,-2 = 2%g 4-1 We 
obtain : 
*2k 
| (a pa? + By x + Yp)dx = 
Xon-2 


3 3 3 3 
on Xo n-3 . x ok —*X a-o : 
a + By meray ae Sere: oe Yu (Xen — X2n-2) = 


= ea { Qaty, (x2 on—2t Xen 2% an + 7%9n) +30 e(%en—2t Xan) + OYE} = 


= aan (apx® 2k- a+ Bexon—- atVi) +( AEX eon t ytye-+72) + 


b—a 
+4 (oH? o4-1+ BeXon-1t Ye) } ie a { Yor-2+ Avox-1+ Jia}: 
Hence the method of parablas gives us : 


2K 


| f@) drane eke Geka 


*en—2 
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and consequently summing for all subintervals 
b 


n 
: b—a 
\F 'x) dxom ar {Vor-2+4 Vora tox} = 
a k=] 


n—l 


nt 
b— 
Ht Yo + dan +4 » Para + 2 » Dek ‘ 
k=1 k=1 


Here, as in the method of trapeziums, the assessment of error 
incurred in replacing the given integral by its approximate value re- 
quires special investigation which constitutes an important calculative 
problem. ‘The calculation which is analogous to that performed for 
the method of trapeziums shows that in the case of parabolas the error 
generally decreases in inverse proportion to n*, 7.e. much quicker than 
in the method of trapeziums. 


For exercises to § 58 cf Problem Book by B. P. Demidovich, 
Section IV, Nos. 275 ~278. 


CHAPTER XVI 
INTEGRATION OF RATIONAL FUNCTIONS 


§ 59. Algebraic introduction 


We have seen in the previous chapter that the simplest method 
for evaluating integrals involves finding of their primitives ; we shall 
now return to this problem in order to enlarge applications of this 
method. In view of the facts described in § 56 we shallnaturally try 
to consider a wide class of functions whose primitives are elementary 
functions. At present we only know one such class of functions, viz. 
polynomials whose primitives are always polynomials; other functions 
with elementary primitives which we have considereda bove are either 
isolated functions or very restricted families of functions. 


The class of so-called rational functions is very closely related 
to the class of polynomials. These functions are said to be rational if 
their value is derived from the independent variable (and constants) 
by rational operations (addition, subtraction, multiplication and di- 
vision) which can be repeated any number of times in any order. 
Hence division is only added to operations producing polynomials 
and this, of course, gives rise to the resulting development. We shall 
now learn to integrate rational functions (7.e. find their primitives). 
It is very remarkable in this connection that primitives of all rational 
functions are elementary functions. In general, these elementary functions 
will, of course, no longer be rational : we know that primitives of 
simple functions like 1 / x and 1 / (1+.°) are transcendental. At the 
same time we shall also develop new methods for finding primitives 
of rational functions. 


All general methodes for integrating rational functions are based 
on their representation in a special form convenient for integration. 
This representation involves algebraic operations and has no direct 
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connection with methods of mathematical analysis. Therefore we 
must begin this chapter with an algebraic introduction. 


We know from elementary algebra that every rational function 
f (x) can be represented in a definite “canonical” form 
fy = Oe (1) 
Q(x)’ 
where P (x) and Q (x) are polynomials with no common roots. Such 
fractions are usually called rational fractions ; if the power of numerator 
of the fraction is lower than the power of its denominator, the fraction 
is said to be regular ; otherwise it is ¢rregular. 


Ifthe rational fraction (1) is irregular, then using the algebraic 
method for dividing polynomials we can use simple rational opera- 
tions and represent our fraction in the form 


me R(x) 
Q (x) aaE (x) ae Q tx) + 


where S' (x) (quotient) and R (x) (remainder) are also polynomials, but 
the power of remainder is always lower than the power of diviser so 
that the rational fraction on the right-hand side of the above equation 
is regular. Hence an irregular rational fraction can always be repre- 
sented as sum of a polynomial and a regular fraction. And since we 
can integrate polynomials, integration of irregular rational fractions 
becomes restricted to integration of regular fractions. We can there- 
fore only consider the case when / (x) is a regular rational fraction. 


In all methods for integrating rational fractions an important 
part is played by the roots of the denominator Q (x) of this fraction. 
If a real or complex number « is a root of the polynomial Q (x), then 
Q (x) can be divided without remainder by the binomial x—z, i.e. 


Q(x) = (* — a) Q* (x), 
where Q* (x) is also a polynomial ; if Q* («) = 0, we have 
Q (x) = (x —a PQ** (x), 
etc. If 
Q (x) = (x — «)FQ, (x), (2) 


where k > 1 and Q, (a) 4 0 (i.e. wis no longer a root of the poly- 


nomial Q) (x) ) we say that the polynomial Q (x) has root « of multi- 
plicity k. 
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Lemma 1. Jf the real number o is a root of multiplicity k > 0 of the 
polynomial Q (x), we have identically 
P(x) _ Ay 4 P, (x) 
Q(x) (x a)F 9 (ww — a)** Qy (a)? 


where A, is a constant and P, (x) a polynomial 








(3) 


The polynomial Q, (x) is defined in this case by the equation 
(2) (so that Q; («) 0), the number 4; is real, all polynomials have 
real coefficients and the fraction on the left-hand side can be regular 
or irregular. 


Proof. ‘The identity (3) is equivalent to the identity 
P (x) — ApQn (x) =(% — a) Py (x), (4) 


which is obtained on multiplying by Q (x); the latter identity implies 
that the polynomial P (x) — A; Q, (x) can be divided by the binomial 
x — «; we know that for this purpose it is necessary and sufficient 
that 





P (x) — A; Qi (x) = 0. (5) 
If we therefore assume that 
P (a) 
Ay = — 
‘ Qi («) 


(remembering that Q, («) 4 0), then the equation (5) will be satisfied 
and the polynomial P (x) — A; Qy (x) will be divisible by x — a, ze. 
we shall have the identity (4) and hence also the identity (3). 


If k > 2, then the rational fraction 


P, (x) 
(x — a)** Qu (x) 
has the same form as the initial fraction P (x) / Q («) ; applying the 


proved lemma to this fraction we obtain : 


Pix «Ap — Ar Polx) 
Te) ~ Gat eat Ga OG) 





if k > 3, this process can be continued until the denominator of the 
last fraction on the right-hand side still contains the binomial x — 
of an arbitrary positive power. Hence we finally obtain : 
A, P* (x) 
as , 
= Qy (x) 








P(x) _ A Aya _ 


(6) 
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where .4,, ..., 4, are real numbers and P*(x) isa polynomial with 
real coefficients, 


In all these arguments we have assumed that the number « is 
real. Our arguments evidently remain valid, for every complex 
number «, but the numbers A; and the coefficients of the polynomials 
obtained are also complex. We did not consider and do not intend 
to consider integration of complex expressions ; ‘therefore when the 
root « is a complex number, we shall cxpand the given rational frac- 
tion by another method. 


If the complex numbcr « = 8B + 71y (Y * Q) isa root of multi- 
plicity & of the polynomial Q (x) (with real coefficients) ,then, as we 
know from algebra, the “conjugate” complex number «* = pB — 1Y 
will also be a root of this polynomial of the same multiplicity k. In 
this case the polynomial Q (x) is divisible by (x — «)* and by (x — «*)* 
and hence also by their product ; and since 

(x — a)(e — a) = (e — By +7, 
therefore we obtain : 
Q(x) = [(* — 8)? + YF Qi (x), (7) 


where Q., («) * O and Q, («*) ~* 0; the numbers 6 and Y and the 
coefficients of the polynomial Q(x) are evidently real. 


Lemma 2. If the complex number « = 8B + iY (Y »* 0) isa rootof 
multiplicity k of the polynomial Q(x), then identically 


ON ce Pek Gs 2 a6 att SEA nt 
Cay) ~ Te —e + Ve * Teer ew &) 


where By, and Cy, are constants and P , (x) is a polynomial. 


The polynomial Q, (x) is here defined by the equation (7), the 
numbers B,, Cy, and the coefficients of the polynomial P(x) are real 
and the fraction on the left-hand side can be regular or irregular. 


Proof. For the sake of brevity let us assume that 
(x — a)(x — a) = (x — B)? + Y? = g(x). 
The identity (8) is equivalent to the identity 
P(x) — (Bu x + Cx) Qs (*) = g(x) Pi @), 


which owing to the arbitrariness of the polynomial P, (x) is, in its 
turn, equivalent to the condition that the polynomial on the left-hand 
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side is divisible by 9(x), i.e. by x — « and x — a*; but forthis purpose 
it is necessary and sufficient that 


P(a) — (Bu + Cr) Qi(a) = Pla*) — (Bra* + Cx) Qi (a*) = 0, 





or 
_ Pla) 
fname Ore Cs 
P (at 
Brot + Cs = Gasp 


Hence we have a system of two equations of first degree with 
determinant % — a* = 2:Y =~ 0 for the evaluation of the unknowns 
B, and C,, and we can therefore always dctermine these two nuinbers 
uniquely; it can readily be seen that in this case the expressions 
obtained for B, and Cy depend symmetrically on « and «* and they 
are therefore real. ‘This proves lemma 2 completely. 


Ifk > 1, then, as with a real root, the last fraction on the 
right-hand side of the identity (8) has the same form as the initial 
fraction on the left-hand side. We can therefore apply the same 
lemma. Continuing this process we find, as before, that if the poly- 
nomial Q(x) has a complex root « = 8 + 7¥Y (Y * 0) of multiplicity 
k and if the polynomial Q,, (x) is defined by the identity (7), then the 
following identity holds : 


P(x) Byx+C, Brak + Cea Byx + CG , P¥(x) 


Qe) Cae Faye Fe gay Fup O) 
where g (x) _ (x = b)? + 7, By, Ba, vey Buy Gy; Ca +2, Cy are 


real numbers and P*(x) is a polynomial with real coefficients. 


We shall now make the following gencral remarks in connection 
with the identities (6) and (9) ; if the left-hand side of either of these 
identities is a regular rational fraction, then thc last fraction on the 
right-hand side will also be regular; this can readily be proved if we 
assume that the variablc x incrcases indefinitcly; we can then see 
that all terms of the polynomial except P*(x)/Q, (x) tend to zero; 
it follows from the identity that the last fraction must also tend to 
zero and it is possible only if the fraction is regular. 


We are now able to convert every regular rational fraction into 
the “canonical”? form which is convenient for integration. The 
denominator Q(x) of this fraction, like any other polynomial with 


270 A COURSE OF MATHEMATICAL ANALYSIS 


real coefficients has, in general, several different real roots «1, %», 
.. a, and several pairs of conjugate imaginary roots By +774, 
BotiVs,..., Bs i¥s.; every real root &m occurs a definite 
number of times k,, (1 < m <r) and every pair of imaginary roots 
Bn + iY, is of multiplicity 7, (1 <n <5). We know from algebra 
that 


OG 256 a Ga ade a Sp Sy” 


26S iss ee Ge ewig Me 


=a] fo -en) "PP —ert7", a0 


m=] n=1 


where a ¥ 0 is a constant. 
f 


Applying the formula (6) to the given function P(x) / Q(x) we 
obtain : 


P (x) ADy, AYg a AM, P. (x) 
2 AY) 2 Pere trong els ath 
xX— Gy Q, (x) 


. Q(x) (e—a)% (x—a,)*, 2 


where 4,, A,, ... Ag, are constant real numbers, 








r 


Qi (x) =a Ul (*— om) *m il [(~-- Ba)? + Yn? Tas 
n=1 


m=2 
and the last fraction on the right-hand side is regular. 


But the fraction P, (x) /Q, (x) is of the same type as the given 
fraction P (x) / Q(x) and we can again expand it in accordance with 
the formula (6) applied to the root «2, say; then we obtain : 


P, (x) = Aicg A P, (x) 
Ona Gag oe yee ope: U2) 





where 


Q.0) =a P @— onl PP — 8)? + 1%, 


m==3 n=] 
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and the last fraction is again regular. Substituting (12) in (11) we 
obtain : 








P (x) All Ney AW, Ano eh) ey Py (x) ) 
Poy ~ Gay to tyre Tea, bo tet a) 


After repeating this process r times (for all 7 real roots a) we 
evidently obtain the identity 


Px). AV : AV AO). 
Q(x) @— a) ' (x — a )E EE 2: X— Uy 


AP gg APD py , 
(x — &)*, (x ay) eet aed xX — he 


AM, Ar) kp-1 aa as = P* (x 
+ Tema) tT &— @)t Hd eos oa ra, + QF (x)’ 


where the last fraction is regular and its denominator 











Qt (x) =a] [Ul — ba)? + 7% T 


n==] 


has only the imaginary roots Bn-k?Y» of the initial denominator Q (x). 
Therefore the “separation’”’ of real roots as expressed by formula (6) 
is no longer applicable to the fraction P* (x)/Q* (x). We shall now 
naturally apply the process of “separation” of imaginary roots as 
defined by formula (9) to this fraction. Similarly we shall in this 
case obtain the following expansion for real roots by applying 
formula (9) s times 











PY. Boe CMA ie, 2h BO i: 
O*(%) [@ —- BP tan (e-Bay + 74 
B®, x + Cr 4 BO, x + 6, 
[(« — Ba)? + Yee ; (x — Be)? + ¥*, 


BOs x + CR 


" 4 ¢ BY, x oe Cs), P** (x) 
[ (x — Bs)? + Vs) 


(x =) Q** (x)? 








Se 


where the last fraction on the right-hand side is regular; but since all 
roots of the initial denominator Q(x) have been used and Q** (x) has 
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no other roots, we must necessarily have P** (x) = 3. Substituting 
the above expansion of the fraction P* (x)/Q* (x) in (13), we obtain 
the final expansion for the initial fraction which we can write in the 
following condensed form : 


£ 


r km le 
P (x) oa Beat 
Cai ae a HE De Bee (00 


m=lu=1 





We were trying to obtain this expansion of the regular rational 
fraction P (x) | Q (x); we have proved that it is always possible; at 
the same time it is also unique : at all stages of the successive deter- 
mination of the numbers A,'™, By’ and C,'™ we have found that 
their determination is unique. However, the. above method for 
successive determination of coefficients of the expansion (14) is not 
usually the simplest method. It is generally easier and more 
symmetrical to use the so-called method of ‘“‘undefined coefficients’. 
We write the expansion (14) with undefined A,'(™, By and C,™ and, 
in disposing of all fractions, multiply both sides of this relation by 
Q(x). Asa result we obtain the given polynomial P(x) on the left- 
hand side and on the right-hand side another olynomial whose co- 
efficients, after comparison with similar terms,. evidently contains the 
unknown numbers A,‘”), By and C,™ and, as can readily by seen, 
are linearly dependent on these numbers. 


Since the resulting equation should be an identity, the 
cofficients of similar powers of x on the right and left-hand sides 
should be equal. Comparing them with each other in pairs, we 
obtain a system of equations of first degree for the unknowns 
A,™, By and C,™, with whose help these numbers can be deter- 
mined ; we know in advance that this problem has a unique solution. 
It can be readily seen that the number of equations of the system is 
equal to the number of the unknowns. In fact, let us assume that 
the power of the polynomial Q(x) is equal to.V. On multiplying 
both sides of the identity (14) by Q(x) we evidently obtain a poly- 
nomial of degree V—1 on the right-hand side; on the left-hand side 
we have the polynomial P(x) whose power is not greater than N—]; 
since the fraction P/ Q is regular. And since a polynomial of degree 
N— lhas NV cochicents. a comparison of coeflicients on the right 
and left-hand sides gives us a system of NV equations. On the other 
hand, the number of the numbers A,° (1 Im <r,1 <u < km) 
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: 
is equal to 2 km; similarly the number of the numbers B,'” is equal 


m=1 
5 


to » !, and the same applies to the number of the numbers C,'”. 


n=1 
Hence the total number of the unknowns is equal to 


aa Ys 


but the éxpansion (10) of the polynomial Q (x) into ‘linear factors | 
shows that’ this number is exactly equal to the power N of the _po- 
lynomial Q (x). Hence the number of the unknowns is, in fact, always 
equal to the number of linear equations obtained. 


Thus in order to write the expansion (14) irrespective of the 
methods by which it was obtained, it is always necessary. to know all 
roots of the polynomial Q (x) and their multiplicity. This is an algeb- 
raic problem which we cannot always solve, but we must nevertheless 
assume that this problem is solvable before proceeding with integra- 
tion of the given rational fraction. 


Example. ‘The fraction 


2x +2 
(x— 1) (x? +1)? 





can, according to formula (14), be represented in the following form: 


— wt? 4. Byxtr 4. Bart | 
(x—1) (x? -1)? x (tle TO e+T ? 


multiplying both sides by (« — 1) (x? + 1)? and comparing similar 


terms on the right and left-hand sides we obtain : 


2x4+2=(A+By)x*+ (Cp—B,)P+(2A +B, + By — Cy)? + 
+°C, -By+C, = Ba)x+ (A—C.—C,) : 


Comparing the corresponding coefficients with one another on 
the right and left-hand sides we obtain the following system of equa- 
tions : 

A+B,=0, G--B=—9, 
2A +B, + B, -- C, = 9, 
Cy + C, — B, — B, = 2, 

A—Q—CQ,= 2; 
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this system can be readily solved and we obtain : 
A=1, B, = — 2, C=0, B=-1. C,=—1. 
Therefore 
2x + 2 ] 2x x+1 


(x — 1)(x* + 1)? x—1 (x?+- 1)? td’ 


§ 60. Integration of simple fractions 


Formula (14) introduced in § 59 shows that integration of any 
regular (and hence also any irregular) rational fraction involves 
integration of a series of rational fractions of a special kind which we 
shall call simple fractions. Simple fractions can be divided into two 
types : fractions of the type 


A 


where A and « are constant real numbers and uw a constant natural 
number, are called fractions of the first kind, and fractions of the type 


Be+tC 
[ep tye ° 


wher B, C, 8 and « are constant real numbers and v is a constant 
natural number, are called fractions of the second kind. In this para- 
graph we shall learn to find primitives of functions for all simple frac- 
tions of either kind. With the help of formula (14) we shall then be 
able to say that we have learnt to integrate every rational function. 


1°, Simple fractions of the first kind. We directly find that 





A 
| an = Aln|x—a«|+ H, 


x—& 


where H is the constant of integration. Similarly when u > 1, we 
directly obtain 





Ad A 
—A 
(u—1) (x— a)" ae 


This evidently concludes integration of fractions of the first kind. 
We can see that the primitives obtained as a result of this process are 
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either other simple fractions of the first kind (for u > 1) or logarithmic 
functions for u = 1. 


2°. Simple fractions of the second kind. Let us at first assume 
that v = 1, ze. we are dealing with a simple fraction of the following 
type 
Be+C 
(x aes 8)? + y?- 
The substitution x = B + Y y (y = (x — 8) / ¥, dx = Y dy) gives: 
ee: 








Bx+C _ [BG+Y2)+C _ 
catered B)P- y* oe = |e Y(1+32) ers 
=4/ ya ee la? = 
1+? +3? 


=F In (1+y*?) + Bp EES arctan y +H= 


Zin} 1+ era ===), t+ +2840 arctan (=) +-H,(1) 


Let us now assume that v is an arbitrary natural number. In 
this case the same substitution x = 8+ » gives: 


Ire Be+C 4 fBe+ ssl ae j4+Cc 
[(x — B? +yyp @ “Pee 
ey 2y dy ,BB+Cf dy 
~ 2yet | (7 et JTF 

Here the first primitive on the right-hand side can again be 
found directly : 


Ya= 








2y dy eee ; 1 
G+" @= Nd +y™ 





ita 


(we assume thatv > 1, since we have already considered above the 
case when v = 1). Hence in order to solve the problem completely 
it only remains to find the primititive 


En (eee aaee 
= |e 


where v is an arbitrary natural number (for the moment we only know 
that J, = arctan y = H). With this view we shall now deduce the 
reduction formula which expresses J+, in terms of J, for every natu- 
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ral v. ‘Hence by knowing J; we can find in succession Ig, J, etc. and 
generally J, for every v. 





~» We have: 
ee 1 : [+ ease 
fo = oat oper = Y ve me ca 
nie < wd 
1.4] > ec oF Saw (2) 


ae tPA. eS \ xg 
“the ieee primitive on the might: -hand side can 1 be integrated, by 
parts; knowing that wee iS estacd ' : 


SS a a Te 
lr + yy _ ~s v(1 + 9)? =e A, . 
We obtain : ee 
iE yay at | ze 
FL b pytt OL EPP o J + ye 


Bite Des tse 
r+ 7 


and the equation (2) therefore gives us 





2v—1 
Teas 5 a: a I, = a a oe fi (3) 
and in particular 
I sty g efG is! ee eee Mecha: ap 
BT AD ee 2 2(1 + y?) } 


etc. Formula (3) is the required reduction formula; thus by deduc- 
ing this formula we can integrate simple fractions of the second 


kind. 


A comparison of results shows that the functions obtained by 
integration of simple fractions (and therefore also by integrating all 
rational fractions) can either be logarithms and arctangents or ration- 
al functions. ‘This also confirms the’ above expressed view that pri- 
mitives of all rational functions are always elementary functions. 


Let us make one more interesting remark. At the beginning of 
our study of integration we have already-drawn attention to the fact 


-INTEGRATION OF RATIONAL FUNCTIONS 277 


‘that the functions In x and arctan x are primitives of very simple 
rational fractions : 


JS amet, | Gig = arctan 2 + ©. 
x +x 


Now that we have completely developed the theory of integrat- 
ing rational functions, we can see that no matter how complicated 
the given rational functions be, their primitives can always be ex- 
pressed in terms of the following two transcendental functions: In x 
and arctan x. 


Numerous exercises for integrating rational functions by means 
of the method of indefinite coefficients can be found zn the Problem 
Book by B.P. Demidovich, Section III, Nos. 174-190; the teacher 
should select about 3 or 4 problems. 


§ 61. Ostrogradski’s Method 


We have seen in earlier paragraphs that integration of rational 
fractions, where the roots of the denominator are known, does not 
cause undue difficulties, although it is often connected with rather 
lengthy calculations. M.V. Ostrogradski found an ingenious general 
method which can often simplify and shorten these calculations. To 
explain this method we shall have to revert to arguments used in the 
last two paragraphs. 


Let us assume again that P(x)/Q(x) is a regular rational frac- 
tion and 


Q(s) =a] P & ~ «ol P Pe Bo? +I) 


m=1 n=1 


We have seen earlier that it is possible to expand the fraction 
P(x) / Q(x) uniquely into simple fractions of the first and second 
kind by using the expansion (14) § 59 used for integration of the 
given fraction. In this case the position is as follows : 


The fraction of the first kind 
A 


(% — a" 
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gives on integration natural logarithms for u = 1 and rational func- 
tions of the type 


_ Adx A 


haae  @= helo (2) 





foru > 1. 


The position is slightly more complicated with fractions of the 
second kind 
ET OL 
((« — By? + 7)” 
Assuming that x = 6 +7, we obtain forv > 1: 





Be+C 7 Ao 
Jie =p? + Ye = OF pe Tele 3) 
where 
_[{ 2 
q5 —— | (1 + y?)? ’ 


and A, and Wy are constants. On the other hand successive applica- 
tion of reduction formula (3) § 60 evidently enables us to represent 
the primitive J, as a sum 
L (9) 
i => Voly SS a + y?)r} F) 

where Y, is a constant, L(y) is a polynomial and the last fraction 
is regular. Substituting this expression in formula (3) and returning 
on the right-hand side from the variable » to the variable x we 
readily obtain : 


Be tC 2 R(x) - dx 
lit = B+ =e — B)? + y?je-t a fe — 6)? + ¥” (4) 


where R(x) is a polynomial, ¢, is a constant and the first fraction on 
the right-hand side is regular. This is the position for v > 1; when 
v = 1 we have formula (1) § 60 in which there are no rational terms 
on the right-hand side. 








We now have a clear picture of the primitive of the fraction 
P]Qwhen expanded in accordance with the expansion (14) § 59. 
We can see (({2) and (4)) that the terms of this expansion in which 
u > | orv > 1 give on integration regular rational fractions with 
corresponding denominators 


(x — m)#-4, E(x = Ba)® + 7e) 
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On adding all these regular fractions we obtain another regular 
fraction 


Py (x) 
Qy (x)? 


whose denominator is evidently equal to 


7 


a) =[Joe-aw [fue —eit+r 5) 


m=1 n=1 


This is the rational part of the integral of the given fraction 
P/Q. The second transcendental part will evidently consist of: (a) 
primitives of those terms of the expansion (14) § 59 in which u = 1 
and v = 1, and (4) primitives of the second kind of the second term 
in formula (4). In all these cases the integrand belongs to one of the 
following types : 


A Bet ne 
x— a? — B+ y?? 





the sum of these integrands will therefore be a regular rational 
fraction 


Po (x) 
Qe (x) : 


where 


Qe (x) =I x en] Tt — Bn)? + Ya]. (6) 


m=1 n=1 


We thus obtain Ostrogranski’s remarkable formula 


x) P(x) 2 (x) 
lao = Once fo 


where the first and second terms on the right-hand side represent the 
rational and transcendental parts of the primitive respectively. Q(x) 
and Q(x) are respectively determined from the formulae (5) and (6) 
and the fractions P,; (x) / Q, (x) are regular. 





The most remarkable feature of this expansion is due to the 
fact that it can be obtained by rational deduction without knowing the 
roots of the polynomial Q (x). In fact, we know from algebra that a root 
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-of multiplicity & > 1 of the polynomial Q (x) is a root of multiplicity 
k — 1 of the polynomial Q’ (x) ; if we therefore assume that 


Q (x) = a] & — an)'n J PL — Ba)? + nT 


m= 1 n=1 


then 


Q (x) ihe —dm)* [Letra “1 R(x) =Qy (x) R(x), 


m= 


where the plynomials Q (*) and R(x) have no common root. This 
shows that the polynomial Q, (x) is the greatest common diviser of the 
polynomials Q (x) and Q’ (x) and can therefore be obtained by the 
usual method for finding the greatest common diviser of two polyno- 
mials, i.e. by successive division. And since the formulae (1), (5) and 
(6) give : 


Q(x) = aQy (x) Qe (2), . 


therefore knowing Q(x) and Q,(x) we can find the polynomial Q(x) 
by elementary operations. Finally to obtain the polynomials P,(x) 
and P, (x) we can differentiate the equation (7) : 


P (x) Qi (x) P’; (x) — Py (x) Q', ( x) P, (x) 
Os) = O%, (x) Tog? 


According to formula (5) each root A of the polynomial Q, (x) 
is a root of the polynomial Q(x) and it follows from formula (6) that 
‘it is also a root of the polynomial Q, (x). If Q, (x) contains the 
binomial x — A of power k > 0, then Q’; (x) contains it also, but its 
power is k — 1, and it appears in Q(x) in the first degree; there- 
fore the product Q’, (x) Q» (x) contains x — A of the same power k as 
the polynomial Q, (x): and since the same also applies to any root A 
of the polynomial Q, (x), Q’; (*) Qs (x) is divisible by Q, (x) without 


remainder, 7.e. 








Q'1 (*), Qe (x) = Qi (x) S (x), 
where S (x) is a polynomial. We therefore obtain : 


Qi (x) P's (x) —P, (x) Q (*) _ Q(x) Qi (x) Py (x) -Qe (x) Py (x) 1 (x) Qi’ (x) x) 


Q* (x) ~ Qs ( (x) Q*1 (x) 


Qil(x) [Qe (x) Py (x)—Py (x) S (x)] gt Qe (x) P’ 1(*) —P, (x) S (x) 
Qe (x) Q?1 (x) Qu (*) Qs (x) ° 
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and after multiplying by Q (x) == aQ, (x) Q.» (x) the expansion (8) 


gives : 


P(x) = a[Q» (x) P's (x) — Py (x) S (x)] + aP, (x) Qi (x). (9) 


In this expansion the polynomials P (x), Q; (x), Q2(x) and S(x) 
are known to us; the highest possible powers of the polynomials P (x) 
and P, (x) which we are trying to find is determined by the regularity 
of the fractions P, (x) {Q, (x) and P, (x)/Q, (x). Hence the polyno- 
mials P, and P, can be readily obtained from the relation (9) by the 
method of indefinite coefficients. It can be readily seen that in this 
case the number of the unknowns coincides with the number of 
equations obtained and the solution of this system is guaranteed by 
the expansion (8). 4 


Hence all elements in Ostrogradski’s formula can, in fact, be 
-deduced rationally and their deduction requires no knowledge of the 
roots of the denominator of the given fraction. Thus, without 
knowing these roots, we can find the rational part of the primitive of 
the given rational fraction. - 


For exercises on Ostrogradski’s method ¢f. Problem Book 
B. P. Demidovich, Section III, Nos. 191-193. 


CHAPTER XVII 


INTEGRATION OF SIMPLE RATIONAL AND TRANSCEN- 
DENTAL FUNCTIONS 


We have seen in the last chapter that all rational functions- 
have elementary primitives, and we have found a general method 
for evaluating these primitives. However, as soon as we go beyond 
the class of rational functions, existence of elementary primitives is. 
no longer a rule than an exception; therefore we can no longer 
construct general theories in the way we did in Chapter XVI. 
Nevertheless, algebraic irrational functions and _ transcendental 
functions contain fairly wide classes which give elementary functions. 
on integration ; these functions include rather simple functions which 
occur very often in applications; the methods available for finding - 
primitives of these functions are rather instructive, and we shall 
consider several important functions of this kind in this chapter. 
In integrating irrational and transcendental functions the so-called 
rationalisation method is of great importance if it is required to trans- 
form the variable of integration so as to convert the integrand 
into a rational function; if this can be done, we can regard our- 
problem solved in principle, since we can always integrate rational 
functions. 


§ 62. Integration of functions of the type 2 ( x, a/ ney ; 
cx td 
When we go beyond the region of rational functions, we find 
among simple functions some functions which besides rational 
operations involve extraction ofa root. Asan example of a very 
general function of this type we can take an arbitrary rational. 
function f(x) = P(x) / Q(x) from which a root of degree n is to be- 
extracted (where P (x) and Q(x) are polynomials); we must then. 
take an arbitrary rational function R (x, y) of the variables x and 
= "/PG) . 
2 NM B65 } 
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hence the following functions can be regardad as simple primitives of 
irrational algebraic functions 


[Rr X, 7 / P (x) dx, 

Q (x) 
where P (x) and Q (x) are polynomials, 2 > 1 is an arbitrary natural 
number and R (x, y) is an arbitrary rational function of two variables. 


However, among primitives of the type (1) there are very few 
which satisfy even the simplest conditions made with regard to the 
number nz and the polynomials P and Q which can be expressed in 
terms of elementary functions. In this paragraph we shall consider 
the case when P and Q are linear binomials (and the number n is 
arbitrary); we shall see that primitives of this type are elementary 
functions which can be readily found. 


Thus we are trying to find the primitive 


[R Ks iy eae dx, 

cx + d J 
where a, b,¢ and d are constants, and n is an arbitrary natural 
number. If we assume that 











Ry (2) 
cx +d 
then 
ax + b di" — b , 
=: jn = = = dt 
cx + d é id “ x — ct" @(t), dx (t) > 


and therefore 


[ e} ms StF hae = | R {9 (£), t}o"(t) di. 


Since the function ? (t) (and therefore also its derivative ?’(¢) is ra- 
tional, therefore,on the right-hand side we are dealing with a pri- 
mitive of a rational function which can be expressed in terms of an 
elementary function of ¢ ; replacing ¢ by its expression (2) in terms of 
x we find the expression for the required primitive in terms of an ele- 
* mentary function of x. 


Example. We must find the primitive 


dx 


Vinee 
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Since both radicals in the denominator are integral positive powers of 
the same radical 12/1 x, this primitive belongs to the class which we 
have just considered above (n = 12,4 = b =d=1;C = 0). 


Assuming that 
WI +x=1, 


we obtainx = #2 —I,de = 12tM a3 /1 fx He, 4/1 +x =8, 
and the given primitive is transformed into 


td dt 
12] it eo ff. 


Rationalisation is thus complete ; we obtain 


12 [AS - oe 12f2= oe ee 








12 [e+ e+ P+ e+ H8+2 +44 1) d+ A = 


SCE 5 anna aa a ae a Fe Vara ps beac 
Ca Te 5a 3 2 


Substituting here ¢ =!2/1 -+ x we obtain the required expression for 
the given primitive in terms of the initial variable x. 


For further examples to § 62 ¢f. Problem Book by B. P. Demi- 
dovich, Section III, Nos. 211, 2!2, 215, 217. 


§ 63. Integration of functions of the type B (x, /ax*+ bx +c) 


If at least one of the polynomials P and Qin § 62 were of.a 
higher degree than the first, then integration in terms of elementary 
functions would have been possible only in a few isolated cases. We 
shall now consider a case which often occurs in ‘applications when 

= 2, Q (x)=1 and P (x) is a trinomial of second degree ax?-+-bx+e; 
we are therefore dealing here with a primitive of the type 


| R (x, Vax? + bx +c) dx, 


where R (x,y) is, as before, an arbitrary rational function of two 
variables. We will now show that it is always possible to rationalise 
such a primitive and this primitive must therefore be an elementary 
function. Thetransformation of the variable of integration necessary 
for this rationalisation differs in each case. 
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1°, Ifthe roots « and 8 of the trinomial ax? + bx + ¢ are real, 
we have (assuming that « > a) 





2 V axt+bxte =V a(x—«a) (x—8) ae af G22. ; 


x— oe 


hence the integrand depends rationally on x and on the radical 


a 2e=? 
x—.a% ” 


and this brings us to the case considered in § 62; we know that 
rationalisation can be achieved by replacing the variable - 


A/ a(x —8) =f, 
xa & 


2°. Ifthe roots of the trinomial ax? + bx + ¢ are imaginary,. 
this trinomial preserves the same sign for all values of x ; we are natu- 
rally assuming that it is always positive ; otherwise the value of the- 
radical would be imaginary for every value of x and the problem 
would become void. In particular, by assuming that x = 0 we can. 
see that in this case we must necessarilly have ¢ > 0 (the method 
which we are now going to describe always leads to the desired result 
for c > 0 irrespective of whether the roots of the trinomial are real or- 
imaginary). Assuming that 


V ax* + bx +e — ve 


x 





=, 


we obtain 
axe + bx tos (ix + VoQ=PP 4 2Vetxte, 
ax tb=txe+2Vet, 


b—-2Vet 
a es 


dx = ?’ (t) dt, 
Vax + bx tomix+ Veet l(t)t+ /c, 
and therefore 


[ Rly VakF bet Jide = [ REP, 19 O+-Ve} edt. 
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Owing to the fact that the funccion ? (¢) (and therefore also its deri- 
vative 9’(t)is rational, we succeed in rationalising the given primitive. 


In both cases the methods for transformation of the variable of 
integration were indicated by L. Euler and they are therefore known 
as Euler’s substitutions. 


Example 1. In the primitive 





Ve — a 
(a> 0, |x|> a), the roots of the polynomial x? — a® = (x — a) (x + a) 
are real. Applying Eiler’s first substitution 


Vee 
x+a 


and assuming that x > a we obtain: 

















x—a_. _ 14+ _ 4at 

pear = eee Se 

2a 1 I 1 — 2 
x+a 


and consequently 


dt dt | amen PO Uc ae 
r= af“ —? frat [if aml Helse 





But 





—~Vxta-—Vx-a 
Java Vana 
= ut VF wy, 


dies papas 
= 3g(V x+a + ¥ x—a) == 


—|— 


and therefore 
; T=In(xt+ Ve —a)+C; 
when x < —a we obtain similarly : 
T=in|x+ Jxt— a(t C. 


Example 2. In the primitive 


I= [—S, 
V xta?? 
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-a® < QO and we can therefore apply Euler’s second substitution : 


2 2 A se 
SRE ch ees ey SY pocoerene ge 











Xx 
-and we obtain : 
_— 2at 2a(1+¢?) 
— [ ee 2’ dx = “(tt 22 dt, 
2at?® 1+? 
Vt + at Spo ee 1 — t2? 





cand therefore 
dt 
I => 2 |“ = In 


Example 3. To the primitive 


' l= [=" + ax 
Vv a* ae Bb? 


either of the two Euler’s substitutions can be applied, However, in 
this case it would be ard to substitute x = at; we obtain 


itt 





+C=In(x+ V¥®+ a) 46. 


T= |———_ = arcsin t + C = arcsin Eas + C. 
J a : 


For further examples to § 63 ef. Problem Book by B. P. Demi- 
dovich, Section III, Nos. 219-222, 245-247. 


§ 64. Primitives of binomial differentials 


We shall now consider integration of a specia! class of algebraic 
functions; integrals of this type frequently occur in applications; 
however, the historical significance of this method is mainly due to 
the fact that it is one of the rare cases of the problem where integrals 
of the given class are elementary but not the functions of that class. 


A binomial differential is an expression of the type 


x(at bx)" dx, 


where all three indeces «, 8 and Y are rational and a and 6 are 


288 A COURSE OF MATHEMATICAL ANALYSIS. 


arbitrary real numbers. We shall find under what conditions the 


primitive 
J= | (a+ bx)" dx 


can be an elementary function. 


Let us assume that x8 = f so that * 


ae caf 
apn yeccnens, gree ” dt. 
B 
We thus obtain 
atl 1 
1 8 Y 
ffs % t (a + bt) dt. (1)... 


We shall now see that 7 at least one of the three numbers (x+1)/8,. 
Y and (a + 1)/8 + Y ts an integer, then I'represents an elementary function. 
We shall also give a method for finding this function. 


1° Let Y be an integer. In that case the integrand in the 





a+ 1 ‘ 
primitive (1) depends rationally on t “sg and ¢; if 
a+] m 
Bon” 


where mand n are integers (n > 0), this integrand has the form 
R (t, &/t), where R(x, y) is a rational function of two variables. The 
primitive J has the form considered in § 62 and it can therefore be 
expressed in terms of elementary functions. 


2°. Let the number («-+-1)/8 be an integer. In that case the 


integrand in (1) depends rationally on ¢ and (a + bt)’; ify = p/4q, 
where p and gq < O are integers, then this integrand has the form 
R(t, £/a+bt) and we have again a primitive of the type considered 
in § 62). 


3°. Finally, let us assume that (2 + 1)/8 + Y is an integer. 
The integrand in (1) can then be written in the form ; 


Ce eae 


t 


*\ We can assume that 8 » 0, forthe case 8 = 0 is evidently. trivial. 
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and it therefore depends rationally on t and (a + dt) / tif Y = p/q; 
If p and g > 0 are integers, then the integrand has the form 


£(h/EEH) 


and we have again the conditions considered in § 62. 


Thus our proposition is fully proved. P. L. Chebyshev has 
shown that the above conditions include all cases when the primitive 
of a binomial differential is an elementary function; if a and 6 are 
non-zero and none of the three numbers («+1)/8, Y and («4-1/8 +Y 
is an integer, then the primitive is never an elementary function. 
Unfortunately the proof of Ghebyshev’s remarkable theorem is too 
complicated to be given here. 


For problems to § 64 cf. Problem Book by B. P. Demidovich, 
Section III, Nos. 252, 253, 260. 


§ 65. Integration of trignometrical differentials 


We shall now integrate some classes of transcendental functions 
and at first consider functions which depend rationally on the 
trigonometrical functions sin x, cos x, tan x, cot x, sec x and cosec x. 
Owing to the fact that all these functions can be expressed rationally 
in terms of sin x and cos x, we are obviously dealing with functions 
of the type R (sin x, cos x), where R(x, y) isa rational function of two 
variables. 


The primitive 
l= [2 (sin x, cos x) dx (1) 


always represents an elementary function. To prove this, it is 
sufficient to introduce the following quantity as the new variable of 


integration 
t (+) t 
an (— ] = 4. 
2 


In this case by only taking values of x in the interval —r/2<«<72/2 





we obtain 
2dt 
x = 2 arctan t, dx = Tate? 
i = Zt cos x = - a 
SEE SS ape 1+? 
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and 
1—?# 2dt 
t=.[ RQ eee 


is the primitive of the rational function. 


Example 1. Find the primitive 


dx 
Pe | aes 
where A? is an arbitrary positive number. We shall consider separa- 


tely the case when A? < 1, A? > land A? = 1, 


1) If A2 < 1, we can assume that 1 — A* = a7, 1 + A? = B. 
Substituting in (2) we obtain : 


r= | 2dt ° l+e _ 2dt y) Bi 





1+PltPe—-MaA-— ef)” Jot + Bye wee a 
1T+n 


mY: tan +) + C, 


+C= = a arctan( an 


vi 
2) If A2 > 1, we assume that 1 — A? = — a4, 1 4+ 2 = B. 


Substituting in (2) we obtain : 








, an | Bt — a) 7 
1= [aoe gp =a” reer ie 
| x , ae Se ee 
i |B tan — 4 1 idle kc a Actes 
= ae Bae eros 
Pp tan—- + a 2 Vey tansy + af z=] 


3) If A = 1, the same substitution gives : 


1= (4 = — + + Ca —ct P+ 

As a result of the substitution (2) the primitive (1) is rationali- 
sed in every case, which is very important as it shows that all primi- 
tives of the kind (!) represent elementary functions. However, this 
substitution is often rather difficult in practice and can be replaced 
by other simpler transformations of the independent variable. Many 
cases can be quoted when primitives of the type (1) can be rationali- 
sed by simpler substitutions like ¢ = sin x, ¢ = cos x or ¢ = tan x. 
We shall consider some such cases. 
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1°. If the function R(x, y) is odd with respect to y (2.e. it only 
changes its sign as y is replaced by —_y), the primitive (1) can be 
rationalised by means of the transformation sin + = ¢. In fact, in 
this case the function 


R (sin x, cos x) 
COs x 


(3) 


does not change when cos x is replaced by — cos x and therefore *) 
contains only the square of cos x; but cos? x = 1 — sin® x, so that the 
function (3) depends rationally on sin x = t. We therefore have 

(sin x, cos x) 


| B Gin x, COS x) dx = {* cos xdx = | RY (t) dt, 


cos x 


where R* (t) is some rational function of t. 


2°. It can be similarly shown that if the function R (x, y) is 
odd with respect to x, the primitive (1) can be rationalised by means 
of the transformation cos x = /. 


3°. Finally if R (x,y) = R ( —x, —y), the primitive (1) can 
be rationalised by means of the transformation tan x = t. In fact, 
replacing everywhere sin x by cos x tan x we obtain a rational func- 
tion R, (tan x, cos x) of tan x and cos x so that 


R (sin x, cos x) = Ry, (tan x, cos x), 
and therefore 
R(— sin x, — cos x)=R, (tan x, — cos x). 


Since the left-hand sides of these two identities coincide, there- 
fore 
R, (tan x, cos x) = R, (tan x, — cos x), 


*) Weare using here the algebraic theorem: if R (z) is a rational function of z 
and R (—z) = R (z), then R(z) is a rational function of z2._ Proof. We are given that 
R(z) = R(—z) =4F[R (2) + R (—2)] 5 if R (z) is a polynomial, the right-hand 
‘side is evidently a polynomial with respect to z* ; in general, let us assume that R(z) 
is equal to P (z) / Q (z) so that 


Riz RA 2) SS 

eis Q (2) A(=2) 

both the numerator and the denominator are polynomials and they evidently do not 
change when z is replaced by —z°; therefore, in accordance with our proof they are 
polynomials with respect to z?, 
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i.e. the function R, does not change when cos x is replaced by — cosx 
and therefore it only contains the square of cos x : 


R, (tan x, cos x) = R, (tan x, cos? x) 
and hence also 
R (sin x, cos x) = Ry (tan x, cos? x). 


Assuming that tan x = ¢ we obtain : 


dt 


cos? x = x + arctan t, dx = 


Lie 
and consequently 


i= | R (sin x, cos x) dx = | Ry (tan x, cos? x) dx = 


l dt 
=| Re (4 ee) 1-2? 


and the primitive is, in fact, rationalised. 


Example 3. The substitution tan x = / gives: 








iE ie = | — Of = |Z =I] +O= In ftanal +6. 
sin x COs x tan x cos" x t 

We shall now consider in detail a very important type of the 
primitive (1), vz. primitives of the kind 


Inn = | sin™ x cos” x dx, 


where m and n are integerss. Evidently if the number n = 2k + 1 is. 
odd, we have the conditions considered above in 1°, and the substi- 
tution sin x = ¢ immediately rationalises the primitive (1); similarly 
if m is odd, the primitive is rationalised by the substitution cos x = ¢ 
(case 2°); finally if both m and n are even or odd, we have the 
conditions described in 3° and the primitive is rationalised by the 
‘substitution tan x = ¢. As we know from above, in every case the 
primitive can be rationalised by the substitution tan «/2 = %. 
However, integration of the resulting function is often rather difficult. 
We must therefore look for other methods of integration; one suclz 
method which does not involve rationalisation is given below. 
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Integrating by parts when n + — 1 we obtain: 
Lisi | sin™ x cos” x dx = | sin”! x (cos" x sin x dx) = 


sin”! x cos*™41 x — m— 1 














ey eee sin™—? x cos"+? x dx = 
n+ 1 ntl 
sin” x cos*tl x» | m—~ 1 L (4) 
fe E l n + | M—2> N+2s 
and similarly when m + — 1 
sin”t1 x cos™1x  n—I1f ... 
I _ : ~ $+ ———~ | sin™+? x cos"? xdx = 
ae m-+ 1 m+ 1 
sin™+1 x cos?-1 os n~— | I (5) 
a am —2: 
m+ m+1 M+2> n—2 
But 
Lge So | sin”? x cos"+® x dx = 
= | sin”? x cos" x (1 — sin® x) dx = Im-oyn — Linans 


and similarly 
Tints n—2 >= Te, n—2 L sas n> 


consequently the formulae (4) and (5) give : 


. -1 n+1 —_ 
_ _ sin™* x cosh x ie m—1 [Lies qd wins: (9) 








Tran n+1 n+1 
sin +1! » cos"1 x n—1 
Dans n— m+ <s m+ [I ms n-2 ncn (7) 


and therefore we naturally also have 








sin™—1 x cos"t1 x m—1 8 
la 7 TD m—29 ns ( ) 
mtn m+n 
sin +1 x» cos"—! x n—1 
T = — + —-- J] ae (9 
me mtn m+n Pr? ) 


We have thus obtained a pair of reduction formulae which 
enable us to diminish either of the two indices in the primitive J», n 
(so long as the other index is not equal to — 1 and m+n 0) by two 
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units while the other index maintains its former value. If both num- 
bers m and 2 are positive, then by successively applying both formulae 
we can evidently express the primitive J, in terms of any one of 
the primitives 1,1, 40, o,9: 4,1 which can be evaluated directly. 


The reduction formulae deduced above enable us to obtain 
results easily when one (or both) of the numbers mand n are negative. 
To prove this we at first note that the reduction formulae (8) and (9} 
remain valid when m = — 1] and n = — I, which we did not include 
in the deduction of these formulae (this can be shown by a simple 
differentiation); the only exception is the case whenm+n2=0. If 
we replace m by m+ 2in formula (8), we can express J m,n in 
terms Of Imo, n) i.e. We can raise the first index by two units if 
m-+n+ 2-40; provided the same condition applies we can use 
formula (9) in order to raise the second index by two units. If 
m-+n-+ 2 = 0 (with the exception of the case when m = n = — 1), 
then either formula (6) or (7) enables us to find J m, 3 since we have 
nx# — 1lform-+n+ 2 = 0, therefore by replacing m by m + 2 in 
formula (6) we readily obtain 


sin +1 x cos™tl x 


aurea + C. 


i mn. 
In view of these facts we can evidently obtain integrable integrals by 
applying successively the formulae (8) and (9) when m and n are nega- 
tive. Note that we have considered the only exception /_,_, in the 
above example. 


For problems to § 65 cf. Problam Book by B. P. Demidovich, 
Section III, Nos. 215-297, 299, 261, 265, 283, 304, 


§ 66. Integration of differentials containing exponential 
functions 


1. Let us consider the following primitive 
I= [=P ©) dx («a+#0), (1) 


where P (x) is an arbitrary polynomial. Integrating by parts -we 
obtain : 


| 


l 
[= ee P(x) — ee (x) dx. 
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This formula replaces evaluation of the given primitive by evaluation 
of another simpler primitive, since the power of the polynomial P ‘(x) 
is lower by unity than that of the polynomial P (x). Repetition of 
this method gives : 


Poa Oe Pe 
cake (x) oe (x 72 x) se 
The resulting series is discontinuons so that the derivatives of the 
polynomial P (x), from a certain order onwards, are identically zero. 


Hence all the primitives of the type (1) can be expressed by elemen- 
tary functions. 


We also note that the following primitives can be similary found 
[ | sin ax P(x) dx, Lp = | cos ax P (x) dx (a ~ 0). 
In fact, integration by parts gives : 


f= — °° pix) + <f cos ax P') de, 
a io 





P(x) — z| sin “x P* (x) dx, 


and successive application of these two formulae readily gives us final 
expressions for both primitives : 


‘ , ryt (5) 
ee saan)? (4) a7 fe Pe {) a }— 
ot a 0 o 
” (4) 
a 2 ae Pe EG, 
a a o 
sin ax a P™ (x) = 
= 4h POs) = a8 org eee 
cos ax(P’ (x) _ P’"(x) ae) — 
+ ¢. va a3 + 06 mY 


Here also both series are automatically discontinuous. 


2. Jet us consider the primitives 


Ky={ e* costade. Ky= |e sin@xde (x #0) 
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Integration by parts gives us : 
B 


k= 4 e* cosBx +=] e** sinBx da = = e% cosix +£x, 


Ky == e% sin Bax— £ Ky. 
If we consider these two equations as a system of two equations with 
the unknowns K, and Ky we obtain : 
__ e* (8 sin Bx + acosBx) 
= oe + B? at G, 
__ ¢** (asin Bx — B cos Bx) 
ky = of +C. 
For problems to § 66 ¢f Problem Book by B. P. Demidovich, 
Section IIT, Nos. 328, 330, 332, 333, 336. ’ 


Ky 





CHAPTER XVIII 
NUMERICAL INFINITE SERIES 


§ 67. Fundamental concepts 


Every branch of accurate nature study contains chapters descri- 
bing the main concepts and laws of the given subject and other chap- 
ters devoted to the study of the subject ; these chapters must be learnt 
not so much in principle as in technique; nevertheless, their methodi- 

-cal importance is often so great that study of the corresponding theory 

is often impossible without their systematic knowledge. Thus in the 
theory of heat we have chapters devoted to the measurement of tem- 
perature together with chapters dealing with theoretical problems 
1.€. practical methods for measuring temperatures. 


The theory of infinite series plays a similar part in relation to 
the fundamental concepts and laws of mathematical analysis, 7.e. it is 
a technical apparatus, an auxiliary tool; also the numerous and 
varied applications of this apparatus are the basis of analysis and 
many applied sciences ; therefore the science of infinite series takes an 
outstanding place among contemporary mathematical methods and 
cannot be omitted from a comprehensive course of mathematieal 
analysis. 


The fundamental concept of the theory of infinite series is so 
elementary that everything connected with it could have been descri- 
bed much earlier in our course, for example, immediately after chap- 
ters devoted to the definition of limits and real numbers. We have 
postponed this subject for two reasons : we wanted to acquaint the 
reader as early as possible with the fundamental ideas differential 
and integral calculus ; we also wanted to connect the elementary 
-concepts of infinite series with later chapters in which their further 
thorough development is described and the reader is only now able to 
-understand this subject thoroughly. 
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The concept of an infinite series is very simple and completely 
expressed by summation of the following decreasing geometrical 
progression with which the reader should be well-acquainted from 
the high school stage : 

Gy GP ihr Saens (1) 
where 0 < }7 |< 1 and a is an arbitrary real number. The sum of 
the first n terms of this progression , 


n—1 
a—ar™ 
= He 
Sg = Yart= : 
e y l—r 
k=0 
when n — co tends to the limit 
lim 5, = ites 
no ow —r 


which is said to be sum of “all’? terms of the given progression : 


be 
a 
ar* = - A 
l—r 
k= 


sate 





Hence in the case of a progression the summation of “all” terms of 
some infinite numerical series is carried out as follows: the sum sy 
of the first 2 terms of the given series is constructed (it is evidently a 
function of n) and the behaviour of this sum for n —» © is then in- 
vestigated. If at the same time s,, tends to a definite limit s, we can 
naturally assume that s is the sum of “all” terms of thisseries. 


A decreasing progression is, however, not the only series of this 
type. Thus, for example, the series 


1 I 1 
ied? 223? 32a eG (2) 


has exactly the same properties. In fact, since 


— 
— 
— 





therefore we have for the series (2) : 
n ? 
a I 1 1 I 1 
a easy =U Se eer al ee oe 


+ (G-sya)-!-se 
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and consequently 


liims, = }. 
n—>0©o 


We have said above that a/ (1 — 1) is the sum of “‘all’’ terms of 
the progression (1); we can now say for the same reason that sum of” 
“‘all”’ terms of the series (2) is equal to 1 and we can write : 


Diy = 
k(k + 1) 
k=] 


It is clear that every series cannot be summed in the manner 
described above. Thus for the series 
lg Wis eters, ee 


we have s, = 2; when 2 —» %, the sum s, increases indefinitely and 
therefore cannot have a limit ; the same phenomenon can take place- 
when s, is bounded ; thus for the series 


ees We Brees: en eee, 


5 is equal to 0 or 1 depending on whether the number n is odd or 
even; when n-—> 00, the sum 5, remains bounded but does not tend 
to a limit. 


We can now formulate general definitions. Let us assume that 
we are given an infinite sequence of real numbers 


Wf ge a Uy es (3) 


We assume that 
n 
se= yay CPO? se 
k= 


and call the sum 54 as partial sum of the series (3). If the limit 


lim Sy, = 5 
n> @o 
exists, we say that the series (3) is convergent and the number 5 is its. 
sum; if, however, the partial sum s, does not tend to a limit for 
n -> oO, then the series (3) is divergent and has no sum. 


The concept of sum of a convergent series and sum of “all” its: 
terms appears to be self-evident, but one must be cautious; it must 
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be remembered that sum of an infinite series is not constructed like 
a finite sum, but an entirely new operation, that of limiting process, 
is involved in its construction ; therefore the properties of finite sums 
cannot automatically be extended to sums of infinite series without 
first testing them ; we shall see later that this extension is not possible 
in every case. 


If the series (3) is convergent and its sum equal to s, we can 
write 


@ 


se Vay = ay Hote toe Fon te 
k=1 


ifs, > + oo for n-> o, this is sometimes written as 


Vur=+o; 
k=1 


but it follows from the general definition that in this case the given 
series is divergent and has no sum. 


Sometimes the following notation is used: wu, + uw, +... + 
+ un +... or y u, irrespective of whether the given series is con- 
k=1 


vergent or divergent. For example, we say that the series 
fae) 


1 : 
aE +1) is convergent and the series (—1)* divergent (cf. 
aie k=} 


above examples). 


If the series (3) is convergent, the difference r, = 5s — 5, between 
its sum and partial sum is called remainder of the given series; it 
follows from the definition of convergence that 


tn > 0 (n co): 


the remainder r,, of a convergent series is an infinitely small quantity for n—0o 
(a divergent series has, of course, neither a remainder nor a sum). 
Since 


$= Uy + Ug +... + Uy “> Unty aS veep Sn Uy oe Up Ae cece SP Uns 
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therefore we naturally expect that 
fos) ao 
Tp = S — Sp = Unty vee Une +. = > Untk = } uj. 
k=1 f=n+1 
This equation which is obvious for finite sums caninot be extended to. 


infinite series without proof. However, the proof happens to be very 
simple ; if we assume that 


7 
y} Una =O; GS 1 oe xsiely 
f=] 
then evidently 6, = 5,4, — 5,3; and owing to the fact that s,4,— 5 for 
r—» co and n is constant, o, has a limit equal tos -- 5, = 7,,for r> 0} 
co 
but by definition the limit of oc, is the sum of the series vy yap 
k=! 
therefore this series is convergent and its sum is 7,, which was to be 
proved. ‘Thus if the series (3) converges, we have for every n > | 
S = Sn + Tn, 

where 


Sn = Uy Ug bw cb May Ta = Unt + Untg Tb + tate + on. 


It follows from our definition of convergence of the series (3) 
that this convergence is equivalent to the condition that the squence 
of partial sums 


Sty Say eee Sng vee (4) 


should tend to a definite limit s which in this case is said to be the 
sum of the series. Hence the sum and convergence of the series (3) 
depend on existence and magnitude of the limit of the sequence (4). 
Thus infinite series can be expressed in terms of sequences and their 
limits. But it can be readily seen that the relationship between series 
and sequences is mutual. Let us assume that we are given the 
sequence (4) of arbitrary real numbers s, and that 


uy = St Un = Sn — Sn-1 (n > 1); 
we then evidenty have 


Uy + uy + oe + Un = Sn (= 152i oh 
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and existence and magnitude of the limit of the sequence (4) depends 
entirely on convergence and sum of the series (3). 


This elementary relationship between sequences and infinite 
‘series can often be conveniently used to apply propositions proved for 
one of these subjects to the other without additional proof. In § 19 
(theorem 2) we have proved the following necessary and sufficient 
‘condition for existence of a limit for the sequence (4): in order that 
the sequence (4) should have a limit it isnecessary and sufficient that 
the following condition be satisfied: no matter how small « > 0, 
-we should have | sary | < © for every sufficiently large n and p > 0. 
But if the numbers s, are the partial sums of the series (3), we have 


p 


Suto — Sa = Unti + Unga +. + Unt = y Un+ks 
k=1 


and, on the other hand, existence of the limit of the sequence (4) is 
equivalent to the convergence of the series (3); we thus arrive at the 
‘following necessary and sufficient condition for convergence of series. 


Theorem 1. Jn order that the sertes (2) should be convergent it is 
necessary and sufficient that the following condition be satisfied : no matter how 
small e > 0, | Unti +Unte +... + Unity | < efor every sufficiently large 
n and for every p > 0. 


This condition can be picturesquely expressed as follows : the 
absolute value of every sufficiently far removed ‘‘part’’ of the series 
{irrespective of the length of this “‘part’’, i.e. of the number of terms 
of the series it contains) should be as small as we please. Thus when 
pp = 1, it follows from this condition that | u, | < ¢ for every conver- 
gent series (3), provided 2 is sufficiently large; in other words, we 
thave : 


Corrolary: Jf the series (2) is convergent, then uy, —> O for 
n->00. 


In the examples of divergent series which we have so far con- 
sidered u, does not tend to zero for n -» 00; therefore the question 
may arise whether the condition u, — 0 (n — co) which, as we have 
just shown, is necessary for convergence of the series (3) is also suffi- 
cient for this porpose. It can be readily shown that this not so. In 
fact, let the series (3) be constructed as follows: At first u = 1 is 
taken ;:then two terms (u2 and uw) each of which is equal to } follow; 
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then follow three more terms, each of which is equal to 4; this is con- 
tinued ad infinitum. It is then obvious that on one hand u,, — 0 for 
n-» oO, Qn the other hand, the “‘part”’ of the series consisting of the 
terms 1/k contains, by its construction, k terms and is therefore equal 
‘to unity. And since k can be as large as we please, the “‘parts’’ equal 
to unity will eccur in the constructed series as far removed as we 
please. The condition of theorem | is not satisfied and the series (3) 
does not converge. 


A classical example of this kind is provided by the very instruc- 
tive ““harmenic’’ series 


1 
nai ar ii a ae ere (5) 


the condition u,,—> 0(n — o) is satisfied, but the “part’’ of the 


‘series 
Qkt. 


ee 


n= 2kt1 


contains 24+} — 2« =: 2* terms, neither of which is smaller than the 
preceeding term which is equal to 1/2*+1; therefore this “‘part’’ is 
greater than 
x 1 ob 
2 kt on 

and since we can select each “part’’ as far removed as we please 
(the number & being arbitrarily large), the condition of theorem 1 is 
again not satisfied and the series (5) is divergent. 


Infinite series, like other general concepts, need more details for 
their full development; their full meaning can only be interpreted by 
considering more or less specialised classes of series which are charac- 
terised by individual properties. In this paragraph we are studying 
the concept of infinite series in its most general form and there 
remains something besides to say. 


Let us assume that we are given two series : 
Uy tue t+... t+ ulpnt..., 
Vz tet... EO ge eas 


In that case the series 


(uy + 23) + (ug te) + eee + (Un toe) +e. (6) 
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can be regarded as the result of “term-by-term” addition of the two 
given series i.e. an addition where each term of the first series is 
added to the corresponding term of the second series. Let us assume 
that both series are covergent. Let us denote their respective sums 
by s and o and partial sums by s, and o, so that 


Sn —>S, On (n —> a). 


In this case the sum of the first n terms of the series (6) will evidently 
be equal tos, +o, andtend to s+ o for n— o; thus term by- 
term addition of two convergent series results in another convergent 
series and the sum of the new series is equal to the sum of the two 
given series. This rule evidently remains valid (and is proved by the 
same method) if the series are subtracted term-by-term. 

Finally, no radical change in our arguments will take place if, 
instead of two series, we take an arbitrary finite number of conver- 
gent series and construct an arbitrary algebraic sum with an arbi- 
trary combination of signs (which must naturally be the same for all 
terms). The series resulting from this algebraic term-by-term addi- 
tion of the given series will always be convergent and its sum will be 
equal to the result of the algebraic addition (with the same combina- 
tion of signs) of the sums of the given series. We thus arrive at the 
following proposition : 


Theorem 2. Lei the series 
y} u loko y u Qk» ee 8 4 by u mok 
k=1 k=] k=] 


be convergent and their sums be respectively equal to $1, Soy... 0 500% 5 Sm 
Then the series 


co 


y} (wis + Uosk ete ose + U myk) 
k=1 


(where the same combination of signs is taken for each term) will also be 
convergent and its sum will be equal to 


Spt-sot... ue Size 


It follows from this theorem that by changing a finite number of 
terms of a convergent series we cannot affect its convergence 
(although we are in general changing its sue) ; in other wore the 
following result holds: : 
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Corollary. If tn the series 


uy tug t vee Hb en tt Ung + or (7) 
and 
Ug PD ge ak eg oe Dea (8) 
we have vr og 
Unty = UCnirs Unia = Unies ae a Untk = Deiees tte 


for n > O and tf one of these series is convergent, then the other series is also 
convergent. 


In order to prove, it is sufficient to note that the series .(8) is 
obtained by term-by-term addition of the series !) and the (conver- 
gent) series 

(0y — wy) + (Vg — He) +. + (Vn — up) HOF O04... 

It obviously follows from the above corollary that if one of the 


series (7) and (8) is divergent, then the other series is’ also divergent. 


Another general property of numerical series is established by 
the following theorem : 


Theorem 3. If the series 
Uy tue t+... tuat... 


is convergent and its sum is equal to s and tf a is an arbitrary constant, then 
the series 


aQu,+ aug t+... batnz +. 
is also convergent and its sum ts equal to as. 


In order to prove this theorem it is sufficient to note that, 
denoting by s, and c,, the respective sums of the first n terms of the 
above two series, we should have co, = as, for any n. 


For exercises to § 67 cf. Problem Book by B. P. Demidovich, 
Section V, Nos. 1-3, 5, 11-12, 14, 15, 21, 23, 24. 


§ 68. Series with constant signs 


We have already remarked above that in order to develop the 
meaning of infinite series thoroughly we must study specific classes of 
series characterised by special properties‘which make them important 
and accessible for study. The history~of the development of the 
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science of infinite series has revealed that the most important class 
of this kind are series whose all terms have the same sign. There- 
fore we shall at first study series with ‘‘constant signs.’? We shall 
always assume in such cases that all terms are positive (or, more 
accurately, non-negative, since, in general, it is useful to assume 
existence of terms equal to zero). It is obvious that series with nega- 
tive terms (or, more accurately, non-positive terms) will possess ana- 
logous properties owing to symmetry. 


If all terms of the series 
Uy tugt.. tugt.. (1) 


ar€ non-negative and if we assume, as above, that 


, 


Yur =S5Sy (n= I, 2, seeds 
a 


then we shall egidcniy have oe = Sn foralln > 1, te. the partial 
sums s, form a non- decreasing sequence. However in this case 
there are only two possibilities as n > co: the sums, may increase 
indefinitely as 5,, > + ©, or it can remain bounded ; in the latter 
case, as we know, it should tend to a definite limit s; but the relation 
S_ — 5(n—> ©) implies that the series (1) is convergent and that its 
sum is equal tos. Hence in order that a series with constant signs should 
be convergent it is necessary and sufficient that its partial sums should be 
bounded. In the general case when the terms of the series have diffe- 
rent signs this condition evidently also remains necessary for the 
series to converge; liOwever, it is no longer the sufficient condition as 
can be seen from the divergent series considered in § 67: 


2 A E(]AD F140 +. 


whose partial sums are only equal to 1 or 0 and which are therefore 
bounded. 


The condition established above gives us a very valuable crite- 
rion for convergence of series with constant signs; convergence and 
applications of many series occurring in analysis can be established 
by the direct or indirect use of this criterion. At the same time the 
above criterion is also valuable from a_ theoretical point of view; 
because of it the theory of series with constant signs becomes very 
clear and accessible and can be developed much further than the 
theory of series with variable signs, to which the above pontiuon: 
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cannot be applied. Its importance can be easily understood. We 
have found in our initial definition that in order to determine con- 
vergence of the given series we have to study the quantity s, as a 
function of m so as to find whether it tends to a definite limit for 
n-» ©; the expression for s, in terms of z is often rather complica- 
ted and does not directly reveal the limiting behaviour of this 
quantity as n-> oo. On the other hand, it is often sufficient to 
assess roughly the quantity s, in order to confirm that it remains 
bounded for n — ©; if the series has constant signs, we -can. directly 
deduce that s,, has a limit and the given series converges. 


Let is consider an example. It is required to find whether the 
series 


] 1 ] 1 
Pa ee Ore ee ea toe 


converges. The expression obtained for the sum of its first n terms 
is complicated and does not conclude as regards limiting behaviour 
of this quantity. However, since 





1 
< by (kK => l, 2 seey n), 
therefore 


1 ] | l l 
Sn Sy Be oe ge ke aa ee he 


Vn" 


for every n > 1. Hence the quantity s, is bounded and the given 
series converges. 


The method used in the above example often enables us to 
determine convergence of concrete series. In its general form it can 
be formulated as follows: 


Theorem 1. We are given two series with non-negative terms : 
Uy tUg+t... Unt... (u) 
Vp t+ vet... 4 On + 3! (2) 
if a positive number ¢ and a natural number no exist in this case such that 
| Un <4 


for every n > ng. then convergence of the series (v) implies convergence of the 
series (u) and, conversely, divergence of the series (u) implies divergence of the 
series (v). 
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This theorem is sometimes known as the. “principle of comparison 
of series’’. 

Proof. It follows from corollary 2 § 67 that we can evidently 
assume without loss of generality that the inequality v, < cu, is 
valid for all n; let us denote by s, and o,, the respective partial sums. 
of the series (u) and (v) ; we evidently have s, <co, (n = 1, 2, ...)5 
if the series (v) converges, then the sums ¢, are bounded and there- 
fore the sum s,, is also bounded which in its turn implies convergence 
of the series (u). “Theorem 1 is thus proved. 

The principle of comparison of series established above can be 
applied not only to the study of definite series but also to the deduc- 
tion of many convenient tests of convergence which find frequent 
applications. We shall establish several such tests in the sequel.*) 


Test 1 (Cauchy). Jf a positive number r <1 extsts such that 
V ty, S? 
for all sufficiently large n, then the series (u) is convergent; if, however, values 
of n exist which can be as large as we please, for which 
WV tn 2 Is 


then the sertes (u) is divergent. 
Proof. In the first case we have for all sufficiently large n 


Un Sr”, 


and, according to theorem 1, convergence of the series (u) follows 
from convergence of the progression r + 7? + ... +7" + .... In the 
second case we have uw, > 1 for an infinite number of values of n and 
divergence of the series (u) follows from the corollary of theorem 1 
§ 67. 
In particular, if the limit 

lim </ uy, 

n> 0 
exists, the above test enables us to establish the following simple 
result s 


Corollary. If the series (u) has lim </u, = 1, then the series (u) is 
n—->o 


convergent Sor | <1 and divergent forl > 1. 





*) Up to the end of § 68 we have considered series which we assume to have 
non-negative terms. 
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In fact, let! <1 and « > 0 be so small that | 4+- « < 1; it 
follows from "/ t, — 1 (n —> 00) that °¥/ u, < 1+ ¢ for all sufficiently 
large n and therfore, according to the test 1, the series (u) is conver- 
gent. If, however, 1 > 1, then </ u, > 1 for all sufficiently large 
n and, according to the test 1, the series (u) diverges. 


In case lim (/ u, = 1, the above corollary does not enable us 
1— 


to draw any conclusions with regards to convergence of the series (w). 
The fact that the series (w) may in this case be divergent can be 
seen from the simple series 


l+til+..++... 
However, we shall soon see that the series (w) can also be convergent 
in this case. 


Test 2. (D’ Alembert). [fa positive number r < 1 exists such that 


Unvy 
i Un 


q7, 


For all sufficiently large n, then the series (u) converges; if, however, for all 
sufficiently large n 


Unty > 1 
Un : 


then the series (u) diverges. 


Proof. In the first case we have for all sufficiently large values 
of n 


and generally 
Unie <upr* (k = I, 2, ...); 


hence, according to theorem 1, convergence of the series (u) follows 
from convergence of the progression 


Unt + unr? +... four +. 


In the second case the terms of the series (u) form, from a certain 
term onwards, a non-decreasing sequence of positive numbers; the 
relation u, —> 0 (n— o) is therefore impossible and the series (u) 
diverges in view of the corollarv of theorem | § 67. 
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Like tcst 1, test 2 gives the following result : 
Corollary. Jf the series (u) has lim uns [un = 1, then the series (u} 


n—> © 


converges for | > 1 and diverges for | > 1. 


The proof is analogous to that of the corollary of test 1 and we 
leave it to the reader. As before, if / = 1, we cannot conclude that 
the series (u) is convergent. 


Example 1. Consider the series 


1 4 1 
Tit on eae ee 








here 
ee 
= "] ere on Re. (n —> 00); 
ni 


i = 0; the series converges ; its sum is equal to e — 1, as can be easily 
calculated on the basis of examples considered in § 39. 


For further exercises ¢f. Problem Book by B. P. Demidovich, 
Section V, Nos. 28-32. 


It is obvious from the proofs of the above two tests that they 
can serve for comparison of the given series with a geometrical 
progression. These two tests can, however, only be successfully 
applied to serics whose terms decrease more rapidly than the terms 
of a geometrical progression. Such series must be regarded as 
‘roughly’? convergent—their terms decrease very rapidly and there- 
fore the remaindcr rp, also tends rapidly to zero as n increases, i.e. the 
partial sum rapidly tcnds to its limits. We say that such series 
“converge rapidly’; the more rapidly a series converges, the more 
convenient it is for practical calculations; if, for example, s, already 
gives us s with a degree of accuracy sufficient for the given problem, 
then all we have to do is to add four terms of our series; if the series 
converges slowly, we may have to calculate, say, 5,9) in order to 
obtain the same degree of accuracy and this will be a much more 
complicated technical operation. For this reason it is sometimes 
said that a very slowly convergent series may appear to be ‘‘practi- 
cally divergent’; in spite of the fact that s, can be as close as we 
please to s when n is sufficiently large, we have to take a very large 
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value of n so as to obtain the required degree of accuracy and we 
cannot evaluate the sum in practice. 


Our two tests cannot be applied to series which converge 
“slower” than an arbitrary geometrical progression. This means 
that for such series the limit / mentioned in both corollaries usually 
appears to be equal to unity. More accurate and sensitive tests 
must be found for these series and many efforts were made in this 
direction, since many extensive classes of series of great practical 
importance belong to these “slowly” convergent series. 


Let us begin by considering a more important class of series of 
the kind 


1 1 1 
Sa a eae (2) 


where s is an arbitrary constant real number. If s <0, the series 
(2) evidently diverges; we are therefore only interested in positive. 
values of s. Ifs = 1, we have a harmonic series whose divergence 
has been established in § 67. And since we have for s < 1 


a ; af (aa 1,2, 4), 


it therefore follows from the principle of comparison of series 
(theorem 1) that divergence of the harmonic series implies divergence 
of the series (2) for every s-< 1. We must therefore only consider, 
the values s > 1. 


We will now show that the series (2) converges for every s > 1. 
Let & > 1 be an arbitrary natural number. Since we evidently have 
x? > k- forO < x < k, therefore - 


k t/ 
be x-§ dx > feats } 


assuming in this eee that k = 2,3, ..., 2 and adding the in- 
equalities thus obtained we have : % a 


"n n 

1 7 om, pone abe ss. l 
Yas] a= (6-1) n Ss—1? 
= 1 


since s > 1. This shows that the set of partial sums of the series (2) 
is bounded for s > 1 which, as we know, is sufficient for the series (2) 
to converge. " 


k— 


~ 
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The method by which we have proved convergence of the series 
(2) for s > 1 is very often used ; we shall give it a general basis in 
§ 107 (theorem 5). At present we only note that this method enables 
us not only to establish convergence of the series (2) but also to give 
a convenient assessment to its remainder. In fact, on the basis of 
what has been proved above we have for k > 1 


k+1 k 


| x dx < as x7* dx. 
k 


k—1 
Summing this inequality with respect to & from n to n + r we obtain: 


ntrt+l1 ea n-+r 


xdy < Le < | ras, 


n n- | 


or, evaluating the integrals 





, : n-+FT 
: = a eer 
(s—1) ns (s—I(n+7r+ 1) > ks S 
k=n 
1 1 





SE ola= 1 (s—1) (ae 7jFt? 


when —> oo, these inequalities give in the limit : 


1 
poh Ee $ ae 


Example 2. When s = 3, we have: 


1 1 1 l 1 


ED ee fee <a ay 
of oe GE Ge SoG ae 


Convergence of the series (2) could not be proved by means of 
cither of the above tests. In particular, the limits 
li nD M Unt 
IM </un , lim — 
nO, noo Un 


‘mentioned in the above corollaries, are equal to unity for the series (2) 
for all values of s. In fact, assuming 


. "/n-* = ty (n= 1,2, ... ) 
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“we have: 


-and consequently (cf. example 5 § 37) 
Inc, > 0, ft, > 1 


for 2 — co. On the other hand 





irrespective of s. 


In the same way in which the above two tests were based on 
-comparison with a geometrical progression, other more sensitive tests 
of convergence can be constructed on the basis of a comparison with 
-a series of the type (2). We shall now prove one such test. 


Test 3 (Raabe). Ifa number r > | exists such that 


n (2 )>r (3) 


Unti 
_ for all sufficiently large values of n, then the series 


Uy + Ug + we Un t+... (u) 


converges ; if, however, for all sufficiently large values of n 


n( -1) <1, (4) 


Unt 





then the series (u) diverges. 


Proof 1. In the first case let us denote by 7’ an arbitrary num- 
ber between | andr (I <7’ <r). Evidently the quantity 


Q42)-1 


ae 
n 





has as its limit the derivative of the function (1 + x)” at x = 0 for 
n—> 00, i.e. the number 7’; sincer’ <r, we have for all sufficiently 
large values of n 
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e ta) —1 


n 








hence 
f LA r 
pita) sles 
But it follows from (3) that in this case 


deel uel) (ely 


Unt n 





or 
n'ug > (n + 1) Und 5 


this shows that for sufficiently large values of u the product n’’u, de-- 
reases in the transition from nto n + 1 and therefore remains boun-- 
ded for n —> o0 ; in other words, a number ¢ > 0 exists such that 


NP tg ZS (n = 1, 2,...), 


or 


oe) 
Since r’ > 1, the series Dee -; > as we have just proved, is con-- 


vergent ; it therefore follows from the principle of comparison of series - 
that the series (u) is also convergent. 


2. In the second case it follows from (4) that 
wu n+l 
n < n+ , 
Un+1 n 
or 
nit <(n + 1) tans 


therefore provided n is sufficiently large (n > m9), the product nu,, does. 
not decrease in the transition from nto n+ 1 ; hence if we assume 
that ny Un = 6 we shall have nu, > c for n > ny and consequently 


Un 2 


=e i 
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and since a harmonic series diverges, it follows from the principle of 
comparison of series that the series (uv) also diverges. We hava thus. 
proved test 3. 


Corollary. If the series (3) has the following limit 


ed =1)=1 


n—>+0O Nata 





then the sertes (u) converges for | > 1 and diverges for l <1. 


_ We can again leave the proof to the reader. When / = 1, the 
given series can either converge or diverge. 


Example 1. Let us assume that for n > 2 
] 1 1 
Uy = a ( apes ee) 


where a is a constant positive number. We readily obtain 


hence 





3 


The limit of this expression for n — © is evidently equal to the deri- 
vative of the function a” with respect to x at x = 0,7.e. Ina. It follows 
from test 3 that the series (u) therefore converges for a > e and diver- 
ges fora <e. The problem needs further study for a = e. 


We could readily construct simple examples of series for which 
the test 3 is too rough. We have just met one such series (a = ¢ in 
the last example). The reader can show for himself that this test tells. 
us nothing about convergence of thc series of the type 


I 
vine 
n=2 


where s is a constant positive number. We could find a more 
sensitive test to throw some light on this problem. In chapter XXV 
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we shall study a test of completely different type based on integral 
calculus which will enable us to operate freely with series of this and 
-other more complicated types. 


For exercises ¢f. Problem Book by B.P. Demidovich, Section V, 
Nos. 42 and 45. 


§ 69. Series with variable signs 


We shall now begin to study series with arbitrary signs. 


Among them we find the so-called alternating series whose terms 
have alternately positive and negative signs so that, for example, all 
‘terms with odd indices are positive. Such a series can be written 
in the form 


uy — Ug bug — Ugt 2... FH Mop-y — Uae +; (1) 


where all u, are obviously positive numbers; alternating series 
occur very frequently and have many different applications; they 
are also interesting theoretically; their convergence can often be 
established by means of a very simple test which we shall now prove. 


Theorem 1 (Leibnitz). Jf the inequality u ny, < uy holds for any 
n > 1 and if lim uy, = O, then the alternating series (1) ts convergent. 


n—> ~ 


Hence for alternating series the tendency of u, to zero for 
n-~» oo together with the monotonic decrease of the absolute value 
of terms guarantees convergence of the series (in general this is, of 
course, not so; let us remind you, for example, of a harmonic series 
which satisfies both these conditions). 


Proof. Let us denote, as usual, the partial sums of the series 
{1) by Sn. We have for every k > 2 


Sg% ~~ Sor-g == Moxy — tox 29; 
hence the sequence 
Sas Sas Se 02+ » Sony oss (2) 
is non-decreasing. But on the other hand 
Sop = Uy — (Ug — hg) — (hg — U5) — 00. — (lge-g — Mona) — Lore 
hence 


Sor Quy (k= l, 2, ona) 
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so that all minuends on the right-hand side are non-negative ; therefore- 
the non-decreasing sequence (2) is bounded from above and has a 
limit 


lim Son = S. 
ko 


In order to prove that the partial sums s with odd indices tend to the- 
same limit, it is sufficient to note that, according to proof, 


Soper = Sex + Uorti 
and that s., > sfor k - 00; it is also given that wo,4, —> 0; therefore- 
Sorti > § (k + o), 
which proves theorem }. 


A typical simple series which often occurs in applications is the- 
following series 


1, 1 | | l 
oie, ae a ye i) es Ye (3) 


which according to theorem | is convergent. If we replace all terms. 
of this series by their absolute values, we obtain a divergent (harmonic) 
series. ‘This shows that convergence of the series (3) depends not so- 
much on the rate of decrease of its terms (their absolute values) as 
on the alternative distribution of their signs. 


The series (3) also shows that it is possible for a given series to- 
converge while the series composed of the absolute values of its terms. 
diverges. It is most important in the theory of all series with variable- 
signs that the converse of the situation described above should not 
occur: if the series composed of the absolute values of terms of the: 
given series converges, then the given series will always be convergent. 
Let 


Uy, tug f+... $n t... (u) 


be a series composed of terms with arbitrary signs. In that case the- 
following theorem holds: 


Theorem 2. Jf the following series ts convergent 
Jul + [ul t.. + [eal tos (|/}s 


then the series (u) ts also convergent. 
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Proof. Let n and & be two arbitrary natural numbers. 
According to theorem | §67 convergence of the series (|«!) implies 
that the sum 


lt nea | te tt n+o| +... ae | ntie| 


is as small as we please when 2 is sufficiently large and & arbitrary; 
-owing to the fact that 


lng tune doe + Unge| S| tata |b tate] +. +] ese, 


the same also holds for the quantity |uniy + tnt, +... + Untels 
-according to theorem 1'§ 67 this also implies convergence of the series 
(u). Theorem 2 is therefore proved. 


We can thus see that convergent series (u) with alternating 
signs can be divided into two categories: series for which the series 
(|z']) converges and the other series for which it diverges. Series of 
the first type are said to be absolutely convergent and those of the second 
type conditionally convergent (the reason for this terminology will soon 
be obvious). The difference in properties of these two types of 
-convergent series is very remarkable and fundamentally important in 
analysis and many applications. This difference can be basically 
characterised by the fact that absolutely convergent series possess 
almost ail properties of finite sums, since all operations with such 
-series are carried out according to the same rules as with finite sums; 
-on the other hand, many simple properties of finite series which are 
very important in applications do not apply to conditionally conver- 
-gent series and therefore practical application of these series becomes 
rather restricted. 


It is evident that convergent series with constant signs always 
-converge abolutely so that the difficulties mentioned above do not 
arise. All propositions which we are going to establish in the next 


paragraph for absolutely convergent series also hold for all series with 
constant signs. 


In conclusion to this paragraph we shall give one more test for 
convergence of series with variable signs. Let «1, «9, ...,%,... and 
Bi, Ba, .... By --- be two sequences of real numbers which possess the 
following properties: 1) the number a, are positive and decrease 


monotonically («,+; << %,) and lim «, = 0; 2) a positive number 
n> © 


C exists such that |o,|=|6,+Be +...+8n| <c for every 
n > l, i.e. the series of numbers 8, has bounded partial sums. Let 
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tus assume thatu, = «,B, (n = 1, 2, ...) and show that the given 
series (u) converges. 


. For this purpose let us apply the general test for convergence 
(theorem | §67) according to which it is sufficient to show that for 
every n and for an arbitrary p > 0 


| nti Unte +... + Unte | < e 
We have 
o(n, P) = Uni + Unto + oe + Unte = 
= &nt1 Bati + &nte Bate +... + Xntp Brtp, 
-or assuming that 
B,+Bet... + Be = oe (k = 1, 2, ...), 
9 (n, p) = &nty (Fntr — Fn) + ute (Fn, — Fntr) +... 
ve FX ntp (Cnty — Fntp-1) = — Fn&nty + nti (%nty — Ente) as 
+ nto (Xnve — %ntg) be +O ntp-1(Xntp-1 — Enty) + Snipe nse; 


let us choose nso large that «nr, <¢/2c; it then follows from the 
inequalities |, | < cand o%z4, <a, which hold for every & that 
the last equation gives us, regardless of p : 


~ 


[o(n, p)| < cons $6 (Ont — ent) + OX ney = 26Gniy < &, 
an 
‘which proves our proposition. We thus arrive at the following test: 


Theorem 3 (Dirichlet). Let 2, > 0 (n> @) and let the follow- 
ing inequalities hold for everyn > 1: 


ant Sen, [Bi tbet... + Bal <e, 
where c isa constant. In this case the series 
oy By +t te Bot... + anBn + 
will also converge. 


By choosing, say, Bn = (—1)"" we exactly obtain theorem 1 
‘as can readily be seen; hence the latter is a particular case of 
theorem 3. : 


Example. We have for every & 


sin (k+—-) « — sin (s-=*) = 2 sin 5 608 ke 
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Summing this relation with respect to & from | to n we obtain 
sin (n + + )t— sin = an Phot 
1 5) 1 5 x= . 


and assuming that sin 4 x 4 0 


e sin(n+ +) x—sin > x 


vi cos kx = ~ - me, 


k=1 2 sin 





and therefore for every n > 1 


Boy <= 


sin - 


Assuming that a, = | /n, 8, = cosmx we can conclude, according 
to theorem 3, that the series 


» LOSS : (4) 


converges, provided «x is not a multiple of 2x; when x = z, the series. 
(4) is transformed into the series 


whose convergence, has been proved above for x = 27; the series: 
(4) then becomes a harmonic series. 


For further exercises to § 69 cf. Problem Book by B.P. Demido- 
vich, Section V, Nos. 74-77, 85-86, 89, 96. 


§ 70. Operations with series 


I. One of the most important properties of finite sums is com- 
mutativity, i.e. the sum is independent of the order of terms; we are 
therefore naturally interested in finding whether this property also 
holds for infinite series, 7.e. whether the sum of an infinite convergent 
series remains unchanged when its terms are arbitrarily commutated 
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and whether the series remains convergent. We shall now learn that 
for absolutely convergent series and for conditionally convergent 
series this problem is solved in a directly opposite sense. 


Theorem 1, Jf the series 


Uy tuet... Hunt... (u) 
4s absolutely convergent and its sium is equal to s, then the series 
Deg ak Se Og wag. 7 (v) 


obtained from it as a result of an arbitrary commutativity of the numbers u ny 
as also absolutely convergent and its sum ts also s. 


Proof. Let us assume that 


Pa= \lual, 


k=n+1 


so that 9, > 0(n— oo). Lete be an arbitrary positive number and 
let n be such that p,, << ¢. The numbers wu, uo, ..., %, of the series 


(w) coincide with some definite numbers v0; , vz ,...,04 of the 
1 2 n 
series (v). Let mn be the greatest of the indeces 14,794 «7m. ‘In 


this case the sum 


m 


Cm = Vox 


k=1 


for every m > m,, evidently contains among its terms all the numbers . 
u,(1 <k <n); it may also containin addition some numbers u; with 
indeces k > n. Therefore assuming that 


n 
Vur=sn (n= 1,2,...), 
k=1 


we have : 2 
Gm=Sn +4 


where g is the sum of several numbers u, with indeces k > n so that 


foo] 


lal< Yo lml = en <e. 
k=ntl] 


322 A COURSE OF MATHEMATICAL ANALYSIS. 


Therefore 
[om —sf=[sa—s+9|<|[o—s| + ]a|= 
=| Powjtiei< ZY lal +l <2, 
k=n+l1 k=nt+l1 
the only condition being that m is sufficiently large. Hence the series 


(v) is convergent and its sum is equal tos. Absolute convergence of 
this series is almost self-evident; in fact, the sum 


yf ve | 
k=1 


is no other than the sum of 7 terms of a convergent series with non- 
negative coefficients | v4; | + |u| +... +! um | + ... and therefore it 
does not exceed the sum of this series for any n; it therefore remains 
bounded for n—» oo and this implies convergence of the series. 


foe) 


y | % |, i.e absolute convergence of the series (z). 





k=1 

We shall now turn to conditionally convergent series and at 
first prove one auxiliary proposition for these series, which is also of 
general interest. 


Lemma. If the series (u) is conditionally convergent, then all its 
positive terms form a divergent series (ut) and, similarly, all ils negative terms 


form a divergent series (u-). 


Proof. We shall denote respectively by st, and s~, the sums 
of those terms of the series (w+) and (u-) which have the partial sums 
5, of the series (u) so that sty + sn = sq. Since the series (u) is. 
convergent, the sum 5, tends to a definite limit for x — 00; hence 
the equation s, = St, + 5n shows that if either of the sums s*t, or 5~q 
has a limit for n — oo, then the other sum must also tend to a limit 
but in this case the difference s+, — s~, must also tend to a definite 
limit which is evidently equal to 


| Lyf t dae} + [te [5 
hence the series (wu) is absolutely convergent, which contradicts the- 


conditions of the theorem. Therefore neither s+, nor s~, can tend 
to a limit for n — 00, i.e. the series (uw) and (u-) diverge, which was. 


to be proved. 
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Theorem 2. Jf the series (u) is conditionally convergent, then an 
appropriate commutativity of its terms can make-tt divergent or convergent, and 
in the latetr case its sum can be made equal to a preassigned sum s. 


Proof 1. In order to obtain a divergent series we shall place 
the terms of the series (uw) as follows: At first we take a certain 
number of positive terms of the series (wu) so that their sum should 
exceed unity (this is possible as a result of the lemma which we have 
just proved). Thereafter we place the first negative term; we then 
take enough positive terms for their sum to exceed unity and we 
place thereafter the second negative term; it follows from our 
lemma that this process can be continued ad infinitum and it is 
evident that every term of the series (w) will sooner or later be 
included in the new series. Our series will, by construction, contain 
‘parts’? >> 1 which can be as far removed as we please; therefore 
according to theorm 1 § 67 the series will be divergent. 


2. In order to obtain a convergent series with an arbitrarily 
preassigned sum s we shall place the terms of the series (u) as follows: 
We assume, say, thats >0. Therefore, at first we take positive 
terms of the series (uw) (in the same order as they appear in this 
series until their sum does not exceed s; this will take place sooner or 
later as a result of the lemma proved above; as soon as the sum 
obtained exceeds s we begin to add negative terms of the series (w) 
(again in their natural order) ; we continue to do so until their sum 
becomes less than s; this will again take place sooner or later as a 
result of the same lemma. As soon as this happens we again begin 
to add positive terms of the series (u), and so on. The resulting 
series 


Vi toot... tig tae (v} 


will, in fact, include all terms of the series (uv) but their position will 
differ. Let us assume that 


i . 
Von = en Gime Te eae) 
k=1 


Let ¢ > 0 be as small as we please. Since v, > 0 forn > o, 
we can find an m such that |v,| < ¢ for > m. Let us consider an 
arbitrary sum o,(n > m);ifo, and Gy, lie on opposite sides of 5, 
then 


lo, —5| <|on— Gna] = lon] <e. 
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If, however, o,, and c,_, lie on the same side of s, then according to 
our construction o,, lies closer to sthano,_;. Hence in all cases y 
lies closer to s than the distance « or it lies closer than the preceding 
sum Gy. This evidently implies that from a certain number 
onwards all the sums ¢,, lie closer to s than the distance e; and since 
e is arbitrarily small, o,, > s(n — oo), which was to be proved. 


We can therefore see that with regards to commutativity of 
terms a conditionally convergent series represents, as it were, a raw, 
amorphous mass which can be transformed, by suitably applying the 
above operation, into either a divergent series or a convergent series 
or a convergent series with a preassigned sum. 


Note. The problem about the influence of commutativity of 
terms of the series which we have considered above arises, as is almost 
self-evident, only when this operation embraces an infinite number 
of terms of the series. In fact, if only terms with indices not exceeding 
m can be commutated, then all partial sums of the series, beginning 
with s,,, remain unchanged; if the initial series is convergent, then 
the series obtained after this commutative operation will also be 
convergent and its sum will be the same. 


2. Another important property of finite sums is their distri- 
butvity : in order to multiply two sums we must multiply each term 
of one sum by all the terms of the other and add the product so 
optained. It is therefore important to know whether this distributive 
law also applies to infinite series. This problem can also be considered 
from another point of view: we have seen §67 that two (or more) 
convergent series can always be added or subtracted term-by-term, 
We are now naturally interested in finding whether it is permissible 
to multiply these series term-by-term. 


Theorem 3. If the series 
type tin. tug ti. =s (w) 


and 


A id ee (v) 
are absolutely convergent, then the series composed of all products of the form 
wid, (2, = 1,2, .. ) with suffixes appearing in any order is also absolutely 
convergent and its sum is equal io so. 


Proof. Let us denote by w,, wy, ..., W,», --- products of the 
form wiv, (2, k = 1, 2, ....) numbered in any order and consider 
the series 


Jy] + lwel +... + lwal +... (|w|) 
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Let S,(n = 1, 2, ...) be the partial sums of this series. The sum Sy 
consists of terms of the form |wiv,|. Among the suffixes 2 and & of 
terms composing the series S,, we can find the greatest term; let us 
denote it by m; if then we multiply term-by-term the finite sums 


An =|t,| + |u| a ae + |un|, Bm =|0,|+]ee]+.-. so lavas 


the terms of this product will evidently contain all the terms |w;7,| 
of the sum §,. Hence 


Sn Qf AnBm 


But the series (z) and (v) are absolutely convergent and therefore the 
sums A, and B,, are bounded; the last inequality shows that the 
partial sums S',, of the series (|w|) are bounded and, consequently, 
this series is convergent. 


We have to prove that the sum of the series 
WytWet... twat pee (w) 


(whose convergence follows, of course, from convergence of the series 
(|w|) is equal to sc. With this in mind we note that since the series 
(w) is absolutely convergent, therefore, in order to find its sum we can 
place its terms (t.e. the products w;v;) in any order (theorem 1). 
Let us place them as follows: at first we take the term wv, (only) 
in which the greatest suffix is unity; we then take all those terms 
whose greatest suffixes are equal to 2 (there will be three such 
numbers: uv), Up Ve, U2v,; after that we take terms with greatest 
suffix equal to 3 (there will be five such terms: #103, %2U3, Ug U3, U3 U2, 
u3V 1), and so on. If we take the partial sum of this series (w) ending 
with a group of terms with the greatest suffix m, then its partial sum 
evidently includes all products of the form uv, (1 <i<m,1<k <m), 
z.e. it will be equal to 5,,¢, where 


Soy = ty + tig + eee Hig, Om = 2 + Vat. +m; 


and since we have s,,—>s and c, —o« for m— oo, the selected 
partial sum of the series (w) tends to so for m-» 00. And since the 
series (w) is convergent, the limit of this partial sum should coincide 
with the sum of the series (w) which is therefore equal to so. This 
proves theorem 3. 


A more accurate analysis which we cannot consider here shows 
that in order to multiply term-by-term the series (w) and (v) it is 
sufficient to assume that either of these series is absolutely convergent 
(and, of course, we must also assume that the other series is at least 
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conditionally convergent). In that case we can no longer place the 
products “;v, arbitrarily, but we must place them in a quite definite 
order. 


When both series are conditionally convergent, term by term 
multiplication isalmost impossible. Hence, in general, only absolutely 
convergent series possess all distributive properties of finite sums. 


For exercises ¢ f. Problem Book by B.P. Demidovich, Section V, 
Nos. 116, 119. 


§ 71. Infinite products 


As we know, addition can embrace an arbitrary number of 
terms ; similarly multiplication can also embrace as many factors as 
we please. Jn the case of addition by allowing the number of terms 
to increase indefinitely and using the principle of limiting process we 
have arrived at the concept of a sum of an infinite series. Owing to 
the fact that addition is in many respects similar to multiplication we 
can expect to arrive at a new useful concept, when the number of 
factors increases indefinitely, by applying the principle of limiting 
process. 


Let 21, 2) .--» Zn be an arbitrary sequence of real numbers. Let 
us assume that 


2 Fg vee Sn i j Ze = Tn (n = 1, 2, sais) 


and call the numbers z, the “‘partial products’’ of the given sequence. 
If the limit 


lim, = 7 
N—>@ 


exists, then, as with infinite series, we can naturally consider this num- 
ber x to be the product of “all” the numbers z, and write 


z= i] 2 ai Se ie Ses 
x=! 


Let us assume that all the numbers Z, are positive. In that case 
n 


log t=), log z, ; if the limit (1) exists and if 740, then it follows 
k=} 
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from x, —> % and from continuity of the logarithmic function that 
log x, — log x, i.e. 


n 
Sn = y log z,—->log = (n> %). 
k=1 


This shows that existence of the positive limit (1) inevitably implies 
convergence of the series 


log z, + log m+... flog z+... (2) 


and the sum of this series is equal to log x. Conversely, if the series 
(2) is convergent, then the quantity 


n 


3 = , log 2, == log (z, 2, ... 2.) = log tT, 
k=] 


tends to a definite limit for n — 00 ; hence the partial product 7 
also has a definite limit (this limit has a logarithm and is therefore 
positive). We thus arrive at the conclusion that inorder that the nonzero 
limit (1) should exist (for positive z,) it is necessary and sufficient that the 
series (2) should be convergent. This enables us to foresee that the case 
mt == 0 will deserve special attention in the theory of infinite products. 


Let us now assume that the numbers z; have arbitrary signs (we 
only assume that there are no numbers equal to zero among them: 
if, for example, z, = 0, then evidently m, = 0 for alln > k and the 
limiting behaviour of =, becomes trivial. We evidently have : 


Tr 





Za = (S235 was.) 


Tn} 
Let the limit (1) exist ; in that case 7, > manda,.,; > nm forn > 
and therefore if x ~ 0 


ine = (n —> oO) ; 


in the same way as the n-th term of a convergent series should tend 
to zero for n->oo, so the n-th factor of an infinite product should tend 
to unity for 2 — oo, provided a nonzero limit = exists. We can see 
that here the case x = 0 occupies a special place ; it can readily be 
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-shown by an example that for = 0 our deduction will, in general, 
be no longer true ; for this purpose we can choose, say, 


mn = (n = 1, Zs ee 
we have t, = 1 / 2"°+0 (n— ©), while z, is always equal to 1/2 and 
therefore does not tend to unity. 


We have thus confirmed for the second time that products with 
a nonzero limit (1) show a more or less close analogy with convergent 
series. This is confirmed by many other facts in the further develop- 
ment of theory. Itis therefore useful to accept the following definition.. 


The infintte product 


ts said to be convergent uf the nonzero limit (1) exists ; if, however, this limit 
either does not exist or, although existing, is equal to zero, then the infinite 
product ts said to be divergent. 


If the infinite product converges, the limit 7 is said to be its. 
value or quantity ; thus the value of an infinite product is always ex- 
pressed by a nonzero number, a divergent product has no value 
(meaning). 


We have seen that the n-th term of a convergent series tends to. 
zero as n-+00. ‘This shows that in every convergent product (3) the 
numbers Z,, from a certain x onwards, are always positive ; the product 
can therefore only containa finite number of negative factors ; if we 
change the sign of each factor, the product as a whole will either change: 
its sign or the sign may remain the same, i.e. it will only undergoa very 
trivial change. Hence without loss of generality we can assume (and 
we will do so in future) that all the numbers z, are positive. More- 
over, owing to the fact that for convergent products z, —> 1 (n — 00),. 
it is frequently convenient to assume that z, = 1 + u, and write the 
infinite product in the form 


[Pata (4). 
n=] 


here we always have — 1 <u, < + ©, and in the case of a conver- 
gent product u,,—> 0 (n —» oo). 
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One of the main aims of the theory of infinite products is to- 
establish tests which would enable us to recognise whether the given 
infinite product is convergent or divergent. As we know, convergence 
of the product (4) is equivalent to convergence of the series 


J} log (1 + tn) 5 (5): 
n=] 
this connection enables us to base the tests for convergence of products. 
on the known tests for convergence of series as established in § 67 ; it 
enables us to confirm the condition that for every < > 0 and for every 
sufficiently large n and k > 0 we should have : 

n+k 

| 2 log (1 + %;) | aS: (6): 

i=n+l 
this is the necessary and sufficient condition for convergence of th 
series (5) and therefore also of the product (4). Since 


ntk n+k 
» log (1 + u;) = log ‘TI (1 -+ wi) ? 
i==n+l1 t==n+1 


the inequality (6) can be replaced by the inequality *) 
nt+k 


| [Po +e0 -1) <a 


i=n+l 


where ‘%, like ¢, is a positive number which can be as small as we- 
please. Hence in order that an infinite product should be conver- 
gent it is necessary and sufficient that any sufficiently far removed (as. 
far as we please) “‘part” of the series should be as close to unity as. 
we please. Hence in this respect we have a complete analogy 
between products and series. Let us draw attention to the fact that 
this analogy only holds if we accept the above definition (i.e. the- 
condition that products with lim ~,, = 7 = 0 are divergent). 


The established test is of great theoretical importance like the 


corresponding test for series; however, it can only be applied in isola- 


*) This number is as closc to unity as we please if and only if its logarithm. 
is as small as we please. 
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ted cases of concrete products. In order to obtain tests of greater 
practical value we must, as in the theory of series, go beyond the 
general concept and consider definite classes of infinite products. We 
must at first naturally ask which products can be regarded as analo- 


gous to series with constant signs and which is analogous to series 
with variable signs. 


The terms of a convergent series tend to zero as their suffix 
increases ;"if the series has constant signs, this implies that all its 
terms are either positive or negative; in other words, all its terms lie 
on the same side of the limiting value 0. In the case of a convergent 
infinite product the limiting value of all terms is unity ; we must 
therefore regard those infinite products as analogous to series with 
‘constant signs in which all factors are either greater or less than 
unity. Ifthe product is represented in the form (4), this means that 
the numbers w,, are either all positive or all negative. For infinite 


products of this kind we have a very simple and practically convenient 
criterion of convergence : 


Theorem 1. Jf all the numbers uy, have the same sign, then in order 
that the product (4) should be convergent tt is necessary and sufficient that the 
following series should be convergent : 


Uy t tg t... ug ta... (7) 


Proof. We can at first assume that u,—>Oforn— o. In 
fact, if this is not so, then, as we know, the product (4) and the series 
(7) are divergent and the statement of theorem 3 is proved. Let us 
now consider both possibilities separately. 


1. Letu, >O0(n = 1,2, ...). Owing to the fact that x > 0 
e*#=—1+x+0(a), (8) 
therefore for a sufficiently large n 
oo Cl tun Se, 


‘We can assume that these inequalities are satisfied for all n, since 
rejection of a finite number of terms cannot affect convergence of the 
series or the product. But assuming that 
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“we have: 


15 28 
ga eee ee (mn = 1, 2, ...). (9) 


Cobet 


‘If the series (7) is convergent, then the sum s, remains bounded for 
n—> 00; it then follows from the second of the inequalities (9) that 
™», also remains bounded; and since Tys, > 7» (n > 1), the product 
(4) is convergent; conversely, if the product (4) is convergent, then 
7%, remains bounded for n -» co ; it then follows from the first of the 
inequalities (9) that s, also remains bounded and therefore the series 
(7) is convergent. 


2. tn <O(n = 1, 2,...). The same relation (8) gives us for 
-a sufficiently large n 


26 a ibs 
é <l+unse? 


? 

and we can again assume that these inequalities are satisfied for all 
values of n, which leads to 

23 ‘an 1s n 7 

Sa has ee Sad a a ee (10) 
If the series (7) is convergent, then s , is convergent for n -> o0 (this 
‘time s, <0 and the fact that s,, is bounded implies existence of a 
positive number A such thats, > — A for any n); it follows from 


the first of the inequalities (10) that z, > so (n = 1, 2,...) and 
owing to the fact that now Tai, < 7, (n > 1), therefore 7, tends to 


.a definite postiive limit = > pe for n—> oo, i.e. the product (4) 
-converges. Conversely, if the product (4) converges, then x,-> = > 0 
(n—» 00) and, evidently, =, > x(n = 1,2... ); the second of the 
inequalities (10) therefore gives: 


oe ae se 2 21m Oia es her ae 
i.e. the sums, remains bounded from below for n — oo ; hence the 
series (7) converges. 


1 
Sa 
e2 


Examples. It follows from divergence of the harmonic series 
‘that for n— co 


(4 B+ d) = (1et)a+e 


(-2)0-$) (1-4) 
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It follows from convergence of the series 
l 
a 
n=1 


that both products 


(0+ BH de (+ Adonai BOB) UB) 
tend to positive limits for n —> 00. 


For further exercises ¢ f. Problem Book by B.P. Demidevich, . 
Section V, Nos. 403, 413, 419, 420, 425. 


CHAPTER XIX 
INFINITE SERIES OF FUNCTIONS 


§ 72. Region of Convergence of a Series of Functions 


Let w(x); u2(x), -.. 5 Un(x) be a sequence of functions with 
independent variable x defined in an interval (a, 6). If we write the 
‘infinite series 


wr (x) + ue(x) +... tun(x) +.., (1) 


then for each value x9 of the variable x in (a, 5) this series becomes 
-a numerical series 


Uy (Xo) + Ua(Xo) + oe tun (Xo) + 


which can be convergent or divergent. A series of the type (1) is 
said to be an infinite series of functions defined in the interval (a, 4). 
These series are an important tool in mathematical analysis, and the 
whole theory of numerical series whose elements were described in 
‘Ghapter XVIII can be regarded as an introduction to the theory of 
‘series of functions which we shall now study. 


Let us at first consider how the concept of convergence can be 
-applied to series of functions. We have already said above that for 
‘every numerical value-of the variable x in the interval (a, 6) the series , 
(1) becomes a‘numerical series so that in view of Chapter XVIII the 
expression (1) can be regarded as describing not a single series but a 
whole family of numerical series. Some of these series will be conver- 
gent and some divergent. It is therefore obvious that we cannot give 
one answer to the question whether the series (1) converges or diverges ; 
such a question should not be put for series of functions. Instead 
the following question should be asked: For what values of x in the 
interval (a, b) ‘is the ‘series (1) convergent and for what values divergent ? 
Hence convergence:of a series of functions is a local concept: it applies 
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at some points of the given interval (a, 6) and does not apply at 
other points. Only when the series (1) converges (or diverges) at 
every point in the interval (a, 4), it can be said that the series converges. 
(or diverges) in that interval. 

A point x in the interval (a, 6) at which the series (1) converges 
is said to be the point of convergence of this series; similarly the point 
at which the series (1) diverges is said to be the point of divergence of 
this series. Hence in relation to every series defined in the interval 
(a, 6) the points of this interval are divided into two sets of points: 
the set of points of convergence and the set of points of divergence of 
the series (1). The first set is known as region. of convergence and the- 
second as region of divergence of the given series. In same cases either 
set may be empty. 

Cases are known in the theory of series of functions when regions. 
of convergence and divergence have very complicated structures ;. 
this may be so even when the series are composed of simple elementary 
functions; it comes about, for example, with the trigonometrical series. 
which we shall study in chapter XXI. Here-we shall only consider: 
one simple case. 


The series 


P+tatepoc at teu, 


all terms of which are defined along the whole number line- 
(— 0 <x < + ©) isa geometrical progression for every value of 
x; the region of convergence of this series is evidently the open interval 
— 1 <x <1; the region of divergence is defined by the inequality 
x] > 1 


Sums of the form 


n 


5n (x) = y ux (x), 


k=1 


in analogy with numerical series, are called partial sums of the series: 
(1). If the series (1) converges at the point x, then the following: 


limit exists: lim s, (x) = s(x). The functions Sn(x) are defined at. 
no 


every point of the interval (a, 5), but the function s(x), which is said 
to be sum of the series (1), is only defined at the points of convergence: 
of this series. The function 7,,(x) = s(x) — s(x) is called remainder- 
of the given series. Itisevident that, regardless of the value of 2, the- 
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function 7,,(x) is only defined within the region of convergence of the 
series (1). At every point x of this region we have: 


lim: ry (4) = "0: 
n> © 


§ 73. Uniform convergence 


We have already noted that convergence of a series of functions. 
y(x) + we (x) ove fb uals) +o 


is local in character. When we say that a given series converges in 

an interval (a, 6) we mean that it converges at every single point in 

this interval, but this does not deprive the concept of convergence of 
its local character. We can, however, introduce another concept of 

convergence of a series of functions in a given interval, which does. 
not imply its convergence at individual points and which has a “‘total’’ 

and not a “‘local’’ character. This concept is of fundamental impor- 

tance in the theory of series of functions and its applications, and we- 
shall now consider it in detail. 


Let the series (1) whose partial sum is denoted by s,,(x) be- 
convergent at every point in the interval (a, 6) and let its sum be- 
equal to s(x); the remainder of the series r,(x) = s(x) — sn (x) tends 
to zero as n — oo at any point x in the interval (a, 5). In detail this 
implies as follows: for every ¢ > 0 and for any x(a <x < 6)a natural: 
number n, can be found such that for every n > no 


bre) |b 


This natural number 7 9, i.e. the ‘“‘spot” from which the inequality: 
(2) is satisfied, evidently depends not only-on « but also on the selec- 
ted point x in the interval (a, 6). Thus different values of x produce: 
different numerical series (1); therefore, in general, the ‘spot’ from 
which | 7 (x) | always remains less than € will be different for diffe- 
rent series. Is it possible to choose my such that for every n > ng 
the inequality (2) should be satisfied for all values of x in (a, 6)? If 
a finite number of values of x exists, this problem would be simple; 
each value of x would then correspond to a definite value of m9 so 
that there would only be a finite number of values of n,; having 
selected the greatest values of my) we would evidently obtain the 
“spot’’ from which the inequality (2) would be satisfied for all values 
of x (of which there is a finite number). However, the interval (a, d) 
contains not a finite but an infinite number of values of x, each of 
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which has a corresponding 7 9 so that we have an infinite number of 
values of m9; an infinite set Of natural numbers does not always 
contain the greatest number; (we must therefore take into account 
the possibility that the number zo, from which “spot” onwards the 
inequality (2) would be satisfied at every point of the interval (a, 4), 
does not exist). We can also see the reason for this : for every point 
x on the given line the “spot”, from which we always have 
| 7” (x) | < e, will appear sooner or later; for some points this will 
happen sooner and for others later; for some values of x the series 
. (1) converges more rapidly and for other values of x more slowly ; 
we can say that convergence of the series at some points “lags 
behind’, as it were, from its convergence at other points, 1.¢ 
.although the series converges for all values of x (a < x < 3), its con- 
vergence is “non-uniform” and takes place more rapidly for some 
values of x and more slowly for other values. 


Therefore the following definition appears useful. 

The series (1) is uniformly convergent in theinterval (a, b) if, no maiter 
what the number ¢ > O be, a nutural number no can be found such that the 
Anequality (2) holds for every n > nq and for every x (a x < 8). 


This new concept of convergence of a series of functions is no 
longer local in character, z.e. it cannot entireiy be reduced to con- 
vergence of the series at individual points and it essentially takes into 
account the comparative rate of convergence at different points. We 
must at first consider non-uniformly convergent series. (Can the series 
(1) which converges at every point in the interval (a, 6) not be non- 
uniformly convergent in that interval ? Let us recall that a similar 
problem has been considered in § 23; having defined, the local 
contunity of a function at every point of a given interval we proceed 
to define the concept of uniform continuity which is more restrictive 
and no longer local in character; however, it appeared later 
(theorem 5§ 23) that every continuous function is also uniformly 
continuous (in a closed interval), z.e. the new concept is no more 
restrictive than the initial concept. We have a similar situation in 
this case if every series (1) which is convergent at every point in the 
interval (a, b) is also uniformly convergent in that interval. However, 


we shall now show that this is not so. 
Let us assume that 


uy (x) = x, uy, (x) = we” — x] (n > 1) 
and consider the series (1) in the interval (0, 1). We have: 


Sn (x) = a+ (x? — x) HH (x — xt) = xn, 
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This gives us forO <x < 1 


lim sy (x) =lim x” = 0, 
n— co n—>o 


while s, (1) = I (x = 1, 2, ...) for x = 1, and therefore 


lim sy, (1) = 1. 
n—>o 

Hence assuming that 
See ae (0<* < 1), 

1 (x = 1), 


we have : 
Sn (x) —>s(x) (OS%e 1); 

in other words, the series (1) converges at every point of the interval 
(0, 1) and its sum is equal to s(x). 

We shall now show that this convergence is non-uniform. The 
point 
Tae 
evidently lies in the interval (0, 1) for every natural 2; but 


Sn (* n) = 4," = Fs (ea) = 0, 


and therefore 
1 


1 
Tn {fn) a= 5 (% n) — Sn (Xn) SoS “xo l tn (Xn) | oS 


Ife < 1/2 (for examples = 1/4), then no matter how large the 
value of n be, a point x, can be found in the interval (0, 1), at which 


| tn (%n) | > 8; 


the inequality (2) cannot be satisfied at every point of the interval 
(0, 1), no matter how large the value of x be; this means that our 
series is non-uniformly convergent in the interval (0, 1). 


It is very important to imagine this phenomenon visually. 
Fig. 47 represents the graphs of the functions y = Ss, (x) forn = 1, 
n = 2 and for a very large value ofm. We can see that no matter 
which point x (0 < x < 1) we choose, the value of s, (x) decreases 
and tends to zero as m increases ; it can be seen from the graph that 
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this value is negligibly small for large n. However, no matter how 
large the values of n we choose for values of x close to unity (for 
example, for x = 1/"/2), sa (x) will still be far away from its limit 


(i.e. from zero) ) : points can be found on the curve y = 5» (x) such 
that their ordinates are still far away from zero; and if we continue 
to increase the number n repeatedly, such points will still appear 
(they will only change their positions by moving further to the right 
or left). The “‘lagging’’ of convergence which we have mentioned 
above can thus be vividly imagined. 


The reader will readily appreciate that no matter how small 
« > O be, the given series will converge uuiformally in the interval 
(0,1 — <¢). Hence only the behaviour of terms of the series in the 
immediate neighbourhood of the point unity inhibits uniform con- 
vergence of this series in the interval (0, 1). 


We can thus see that a series of functions can converge non- 
uniformly in the given interval. This means that the concept of 
convergence of a series, which 
we have introduced above, is 
more restrictive than the con- 
cept of local convergence of a 
series in an interval. In the 
next few paragraphs we shall 
consider several general prob- 
lems in which the concept of 
uniform convergence is of fun- 
damental importance. At pre- 
sent, however, we shall only con- 
sider tests which will enable us to 
establish uniform convergence 
of a series in a given interval. 





Fig. 47. To begin with, there 

holds the following necessary 

and sufficient condition for uniform convergence (which is therefore 

theoretically very valuable) which is analogous to theorem | § 67 for 
numerical series. 


Theorem 1. In order that the series (1) should be uniformly convergent 
in the interval, (a, b), it is necessary and sufficient that the following condition 
should be satisfied: no matter how small « > 0 be, the following inequality 
hold will for all sufficient'y large values of n: 


INFINITE SERIES OF FUNCTIONS 239 


| » uy, (x) ae | ny (x) H+ Unyo (x) Fw. tgp (x) | <2, (3) 


arrespective of the natural number p and the point x in the interval (a, 6). 


Proof. 1. Ifthe series (1) converges uniformly in the, interval 
{a, b), then for n > ng and for every natural p 


te |< a] tele) <H (a< x <8), 


and therefore 


nee l= y ty (*) <2 (a <x < 8), 


which proves the necessity of our condition. 


n+p 
2. Owing to the fact that 7, (x) = lim > u,, (x), therefore in 
poe t 
k=n+} 


the case when the inequality (3) holds for every natural. number p 
and at every point x in the interval (a, 6) we have : 


lmisyl Se (@<w <8), (4) 


and it therefore follows from the condition of theorem 1 that the 
inequality (4) will be satisfied for every <« > 0 provided x is sufficiently 
jarge; this means that the series (J) is uniformly convergent in the 
interval (a, b) ; hence we have proved the sufficiency of the condition. 


In concrete cases uniform convergence is frequently established 
by means of the following simple and very convenient’ sufficient 
condition. 


Theorem 2 (Weierstrass’ test). If the following numerical conver- 
gent series with positive terms exists : 


ay + ae + ses + ayn See ae) (5) 
so that 
| tin (x) | <a (2 = 1,2,...5 aS x < ), (6) 


then the series (1) is uniformly convergent in the interval (a, 6). 
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Proof. No matter how small ¢ > 0 be, it follows from theorem 
1 § 67 that the following inequality would hold for all sufficiently 
large values of n 


Anty + Ante +... + anty < €, 


regardless of the natural number ~. But it then follows from the 


inequalities - that 
Picdeiesweess, 


| Unix (2) 
k=1 


provided n is ive large and f is an arbitrary natural number. 
We therefore conclude from theorem | that the series (1) is uniformly 
convergent in (a, b); theorem 2 is thus proved. 





For exercises to § 73 ¢f. Problem Book by B. P. Demidovich, 
Section V, Nos. 242, 243, 245, 246, 261, 262, 264, 268, 279, 285, 286.. 


§ 74. Continuity of sum of a series of functions 


In the study of numerical series we were considering as to which 
properties of finite sums also hold for infinite series, z.e. to what extent 
we Can treat series in the same way as finite sums. We are naturally 
also interested in the same problem with regard to the theory of 
series of functions. 


We know that sum Of a finite series of continuous functions is. 
always also a continuous function irrespective of whether we consider 
continuity at a given point orin a given interval. Does this property 
of finite sums also hold for infinite series ? If all terms of the series 


uy (¥) - uy (x) +... oun (x) +... (1) 


are continuous in the interval (a, 6) and if the series (1) is convergent 
at every point of this interval, then are we justified in maintaining 
that the sum s(x) of this series is also continuous in the interval 
(a, b) ? We already know that this is in general not so. In § 73 we 
have considered the following series as an example 


uy (x) = x, Un (x) = x” — xn! (n> 1), 


all terms of which are continuous in the interval (0, 1), and we found 
that this series is convergent at every point of the interval (0, 1) and 
its sum is equal to 
_f 9 O<*e < J), 
=f) wab, 
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4.e. it is a continuous function. However, let us note that we have 
constructed this example in order to obtain a non-uniformly conver- 
gent series and we have, in fact, found that this series is non uniformly 
convergent in the interval (0, 1). We therefore naturally tend_ to 
think that this non-uniform convergence is responsible for discontinuity 
of the obtained sum and this phenomenon could not take place, had 
we constructed a uniformly convergent series. This assumption can 
be fully confirmed by the following theorem : 


Theorem {. Jf all terms of the series (1) which is uniformly conver- 
gent in the interval (a, b) are continuous in that interval, then the sum s(x) of 
the series (1) is continuous in the interval (a, b). 


Owing to the fact that continuity of the terms u,(x) of the 
series (1) is completely equivalent to continuity of the partial sums 
Sn(x) of this series, the statement of theorem I is equivalent to the 
statement that if all terms of the sequence 5, (x), 59(*), .-- , Sn(*), --- 
which tend uniformly to the limiting function s(x) in the interval 
(a, 6), are continuous in that interval, then the function s(x) is also 
continuous in that interval. 


Note. We have seen that the sequence of functions 


Si (x) fe (x), «-. stn (x), . 


converges uniformly to the function f(x) in the interval (a, 6) if for 
every ¢ > 0 a number ny can be found such that for n > nm and for 
a<xx <bwehave: 


| fn (x) — fla) | <s. 
It is evident that uniform convergence of the series (1) is equivalent 
to uniform convergence of the sequence 5; (*), 52 (x), ... 5 $n (x), .-. of 
its partial sums. 


Proof. Let ¢ be an arbitrary positive number and let « be 
an arbitrary point in the interval (a, 6). Since the series (1) is 
uniformly convergent in that interval, we have for sufficiently large 
values of n: 


| s (x) ~ sn | <ye (ax —@ ob). 4 (2) 


Let us now fix a definite uumber x which satisfies this inequality. 
Since the function s,,(x) is continuous at the point «, there would 
exist a 8 > 0 Such that 


| Sn (#) — Sn (a) |< -s, (3) 
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ifand only ifjx — «|< 3. But 
| s(x) ~ (a) | = | E(x) u(x) + E509) —5m(@)] + Eonle) 80) < 
si, : < | s(x) Se x)| +1Sn (x)— —Sn(o) | + | Sn (a) —s(%)]; 
it follows from (2) that the first and third terms on the right-hand 
side are jess than e/3 irrespective of the points x and ain (a, 5); it 
follows from (3) that the second term is less than ¢/3, provided 
|x —o| <8, Hence, provided this condition holds, each of the 


three terms on the right-hand side is less than </3 and therefore 
their sum is less than <; we thus obtain: 


Is (x) — s (®)| <e, 





x —a|< 8; since e > O is arbitrary, the funetion s (x) is conti~ 
nuous at the point «; and owing to the fact that a can be any point 
in (a, 6), the function s («) is continuous in that interval; theorem 1 
is thus proved. 

Uniform convergence of a series of continuous functions gua- 
rantees coritinuity of the-sum of that series. In fact, in most concrete’ 
cases continuity of the sum is established by means of this method by 
making reference to continuity of the series itself. However, it is 
also interesting to note that in some cases a non-uniformly conver- 
gent series of continuous functions can have a continuous sum so 
that the converse of theorem 1 is not true. We shall now prove 
this by an example. Let us select the terms of the series (1) so that 


Se = Le) (== 15 2, vse) 5 
in this connection it is evidently sufficient to assume that 
m 2 (x) =5,(x) = x(1—x), 

‘Unl 2) = Sal) —5y-4(x) =x"(L—a") —xt-1(b—x™4) (n>). 
And since for O<x <i 

. . Os Sy (x) <x, 
therefore s, (x)->0 (n—> oo), where O0< «<1; andsince s, (1) = 0 for’ 
every », therefore s, (1)->0 (n> 00) so that 5, (x) tends to zero at every 
point in the interval (0, 1). The sum of the series (1) is identically 
zero and therefore continuous. But on the other hand we have for 
x= "/1/2; 

bre (x)| = sa (2) = 4. 


and therefore no matter what 7 is, the inequality 


[7m (x)| <c 


t 
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for = < 1/4 cannot hold for all points x in the interval (0, !) so that 
the series is non-uniformly convergent. In this case it isalso interest- 
ing to imagine this phenomenon visually. Fig. 48 represents the 
graphs of the functions » = s, (x) when 2 = 1, n = 2 and when nis 
very large; each of these functions has (as the reader can readily 
calculate) the maximum value 1/4 which the function s, (x) takes 
when . = 1/4/2. Hence as n increases this maximum, whose value 
remains constant, will move to the right and tend to the point I. 
Therefore, no matter how close to unity we select our point x, this 
maximum will move farther to the right than x for a sufficiently 
large n while at the point + the function s, (x) will decrease and tend 
to Zero asm increases; on the other hand, however, no matter how 
large the value of n be, a point can be found (x = I/</2) where 
Sy (x) = 1/4, 7 e. points can always be found where the tendency of 
Sn (x) to zero will considerably ‘‘lag’? behind and we are unable to 
find a value of n for which s, (x) would be less than, say 1/8 at every 
point in the interval (0, 1); this show nonuniform convergence of the 
constructed series. 


Hence if uniform convergence of a series of continuous functions 
is in general not a necessary condition for continuity of its sum, a 
very important class of functions exists, for continuity of whose 
sums this condition is necessary. They are series with non-negative 
terms (and, in general, series with constant signs). In fact, let us 
assume that the series (1) has a continuous sum s(x) in the interval 
(a, 6); let all w, (x) be continuous in (a, b) and 


Up, (x) 2 O(n = 1,2, ...3 ax < 3B). 


Let < be an arbitrary positive number; a suffix n can be found for 
every point xin the interval (a,b) such that 7, (x) = 5 (x) — 5p (x) <€; 
and since the function 7, (x) is 
evidently continuous, this equ- 
ation which holds forthe point 
x should, according to the 
lemma § 23, also remain valid 
in an interval which contains 
the point x within itself (or 
when this point is one of its 
ends, i.e.x=aorxv=4b). The 
set of all such subintervals constructed for all the points x in the 
interval (a, 6) will evidently cover this line. It follows from the 
theorem on finite coverage (lemma 2 § 18) that a finite sequence Aj, 
Ao, -», As of constructed subintervals exists which also covers the 





Fig, 48. 
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given interval (a, 2). It follows from the construction of the covering 
system of subintervals that for every subinterval A; (1 <k <s) 
there exists a suffix n, such that 

Tn, (x)<e 


for all points x in the subinterval Az. But since all uw, (x) are non- 
negative, therefore r, (x) can only decrease as n increases ; hence if we 
denote by m the greatest of the s numbers 7, mg, ... , ms, then the 
inequality 
Yon (x) <¢ 

will hold for all the points in every subinterval A, and hence also 
for all points in the interval (a, 6). Andfsince < is arbitrary, this 
proves uniform converzence of the series (1) in the interval (a, 2). 


Theorem 2. For the series (1) whose terms are continuous and non- 
negative in the interval (a, b) uniform convergence is the necessary and suffii- 
cient condition in order that the sum of the series should also be continuous in 
the interval (a, b). 


§ 75. Term-by-term integration and differentiation of series 


We know from integral calculus that the sum of a finite number 
of functions integrable in the interval (a, 6) is also integrable in 
that interval and integral of the sum is equal to the sum of integrals 
of individual terms. Can this rule be extended to infinite series ? 
If all terms of the series 


ty (x) -b uy (x) + oe. 4 uy (x) +... (1) 


are integrable in the interval (a, 6) and if the series (1) converges at 
every point in this interval, can we maintain that the sum s(x) of this 
series is integrable in the interval (a, 5) and that. 


b b b b 
[se dx = | uy (x) dx + Ug (x) dx +... +| un (x) (dx) + ...? (2) 


If the equation (2) holds, we shall say that the series (1) can be 
integrated term-by-term in the interval (a, 0). If we denote the partial 
sum and the remainder of the series (1) respectively by sa(x) and r,(x), 
we evidently have 


b b b 
lim | s,(x) dx = | s(x) dx, lim | Tn (x) dx = 0 
1—> oD N—> © 
a a a 


and, conversely, either of these two relations leads to the relation (2). 
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It can be readily shown that term-by-term integration of series 
-of functions is not always possible. In future we shall assume for the 
sake of simplicity that the terms of the series (1) are continuous in 
(a, b), for many different complications’can occur even with this 
restriction. It may at first happen that the sum s(x) of the series (1) 
is not integrable in the interval (a, b), Let us consider the following 
example (in which we shall define the functions s,(x), as we know 
that the terms «,(x) of the series (1) are defined directly and uniquely 
with reference to them). Let us assume that 


1 
: 0<*e gq — > 
pines n°x ( <*<—) 


1 (Lereds 


the graph of the function y = s,(x) is shown in Fig. 49. For every 
x>O0O we have s,(x) =1/x, provided I/n <x; __ therefore 


lim sp (x) = 1/x foreveryx> 0 Ifx =0, then s,(0) = 0 forany n 
I—> 


and therefore lim s,(0) = 0. Hence the function s,(x) has for any 
n—-> ao 


x (0 < « < 1) the following quantity as its limit : 


s(x) = 
0 (x = 0); 


in other words, the series (1) converges at every point in the interval 
(0, 1) and its sum is the function s(x). ‘The partial sums s,(x) and 
therefore also the terms uw, (x) of the 
series are continuous and can there- 
fore be integrated in the interval 
(0, 1}. However, the function 5, (x) i 
cannot be integrated in that interval. 
In fact, since the function s(x) is non- 
negative, we have for any «(0<a«<1) 


= 127 


vu 


] 1 


J dx > [ sc dx =: 





Fig. 49. 
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but In 1/« is as large as we please for a sufficiently small a and we- 
arrive at an obvious contradiction. 


It can happen on the other hand that the function s(x) is 
integreable, but the series on the right-hand side of the equation (2) 
diverges. Let us select the functions s,,(~) 
for n > 2 as follows: let s, (x) = 0 for 
x > 2/n and let s, (x) vary in the interval 
(0, 2;n) as shown in Fig. 50. We have 
5,(0) = 0 forany n; if, however, 0<*x<l, 
we have sn (x) = 0 for 2/n < x and there- 


fore lim 5,(x) = s(x) = Oat every point x 
n~>o 


in the. interval (9,1) so that its sum is 
identically zero; but on the other hand, 
> the integral 

x 

1 


| Sn (x) dx 


0 





is equal to the area of an isosceles triangle shown in Fig. 50 and is 

therefore equal to n; we therefore have (assuming ffor the sake of © 

generality that s4(*) = #4 (x) = OforO0 < + < 1) 
1 n 4 


| se) dx = y [ wd = 03 
0 k=1 0 


hence the sum increases indefinitely as n — oo and the series on the 
right-hand side of the relation (2) diverges. 


Finally it may happen that the sum s(x) is integrable and the 
series on the right-hand side of (2) is convergent,.but the equation (2) 
is not valid. To obtain an example of this kind it is sufficient to 
assume that the altitude of the triangle shown in Fig. 50 is equal to - 
n instead of n® and retain the former definition of the function s»(x). . 
We then have, as before, s(x) = 0 (0 < x < 1) and consequently 


1 
| s(x) dx = 0; 
0 
but now 
1 n J 


[ s() dx = > |» (x) dx = 1 SS Bee 3 


0 k=1 0 
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the right-hand side of the equation (2) is equal to unity and the left- 
hand side equal to zero. 


We shall now show that neither of the cases considered above 
hold for uniformly convergent series which can therefore aiways be 
integrated term-by-term. 


Theorem 1. Jf all terms of the series (1) ave continuous in the interval 
(a, b) and if this series converges uniformly in that interval, then the relation 
(2) holds. 


Proof. Uniform convergence of the series (1) at first implies. 
continuity and therefore also integrability of its sum s(x). More- 
over, no matter how small ¢ > 0 be, we have for a sufficiently: 
large n 

Im(dl<e (a<x<d). 


Therefore for sufficiently large n 


b 8 
| fr) de | < [frm | de <2 (ba) 


hence 
b 
[ro G)de>0 (n> 
a 


and this, as we have said before, is equivalent to the relation (2). 
Theorem | is thus proved. 


Uniform convergence ofa series of continuous functions which. 
is a sufficient condition for term-by-term integration of the series is, 
however, not the necessary condition for this purpose. This can 
be readily shown with reference to the example considered in § 74 of 
a non-uniformly convergent series 


Sn (x) == x” — 22%, s(x) = 0 (0<x <1). 
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-and therefore 


J 1 
lim Sn (x) dx = | AY (x) ax ; 
ln @ 3 


this relation, as we know, is equivalent to the relation (2); hence the 


series can be integrated term-by-term, although its convergence is 
non-uniform. 


Finally we shall make the following remark. If the terms of 
the series (1) are continuous and the series is uniformly convergent in 
the interval (a, 5), then the same condition also holds for any interval 
(a, x), where a <x <b. We therefore have 


x 


Owe LT (sue (3) 


a n=la 


‘The terms of the series on the right-hand side of this equation are 
functions of x, which are continuous in the interval (a, ). Denoting 
the remainder of this series by R, (x) we evidently have: 


x 


Ras) =[ 0) = se ld =| ro) dys 


a 


let n be so large that !7,(y)| <<«(a@ <y» <4); in that case for 
agxsb 


| Rn (x) | <[ laid <e (x20) <e(b — a). 


This shows that the series (3) converges uniformly in the interval (a, b). 
We thus arrive at the following proposition which can be regarded 
as a generalisation of theorem I. 


Teorem 2. Jf all terms the series (1) are continuous in the interval 
(a,b) and the series converges uniformly in that interval, than the relation 
(3) holds uniformly fora <x <b. 


Finally let us consider the problem of term-by-term differen- 
tiation of series of functions. The implications of this problem are 
already clear to us. The sum ofa finite number of functions diffe- 
rentiable at a given point x is also differentiable at that point and 
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the derivative of the sum is equal to the sum of derivatives of individual 
terms. We want to know, under what circumstances this condition. 
can be extended to infinite series of functions. 


Let the series (1) converge at every point in the interval (a, dD) 
and let all terms of this series have continuous derivatives in that 
interval. Let us assume that the series 


ih Gee ats (a. deer al ee ks (4) 


is uniformly convergent in the interval (a, 6). Let us denote by s (x) 
the sum of the series (1) and by ¢ (x) the sum of the series (4). It 
follows from theorem 2 that we have fora <x <b: 


ie ole: 


J tna=J Jue =P @) - 4 @] = 


I n=] 


n 


co 


= > Un (x) — - un (a) = 5 (x) — 5 (a). 


n=] n=} 


It follows from a well-known property of integrals that the left- 
hand side of this equation is differentiable with respect to x and its 
derivative is equal to ¢ (x); we therefore conclude that the function. 
s (x) is differentiable and 


v@=t(xy= yi un’ (x) (a<«x <b), 
n=1 
i.e. the series (1) can be differentiated term-by-term at the point x. 


We have thus proved the following proposition : 


Theorem 3. Let the series (1) converge at every point in the interval 
(a, b) and let its sum be equal tos (x) (a <x <b). Lf all terms of this 
series have continuous derivatives in the interval (a, b) and if the series (4) is 
uniformly convergent in that interval, then the function s(x) also has a conti- 
nuous derivative in the interval (a, b) and 


pea) 


(x) =) un’(x) (agx <b), 


n=1 


i.e. the series (4) can be differentiated terim-by-term at every point in the 
interval (a, b). 
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Hence uniform convergence of the series (1) and not of the 
‘series (4) which is composed of derivatives of terms of the series (1) is, 
in this case, the necessary condition for term-by-term differentiation. 


As a rule the condition established by theorem 3 is very con- 
venient when applied to concrete series; in practice ‘term-by-term 
-differentiation of many series isestablished by means of this condition. 
It must be noted that differentiability of the sum s(x) of the given 
series is not assumed in theorem 3 but proved on the basis of the 
conditions of the theorem. 


For exercises to § 75 ¢f. Problem Book by B. P. Demidovich, 
Section V, Nos. 287, 294, 295. 


CHAPTER X.. 
POWER SERIES AND SERIES OF POLYNOMIALS 


§ 76. Region of convergence of a power series 


Among various functions studied in mathematical analysis the 
‘simplest and theoretically and practically most important class is the 
so-called power series, i.e. series of the type 


Ay + aye + agx® +... fH agx™ +... , (1) 


where @,4,,  , @, are constant real numbers; sometimes a more 
general expression of the following kind is also called a power series : 


Qa + a, (x — a) + ag (x — a)? 4... fay, (x — a)? 4+, 


where @ is a constant real number. The importance and simplicity 
of this type of series is first of all due to the fact that the partial 
sums s,(x) of the power series are expressed in terms of ordinary 
polynomials; therefore if the series (1) is convergent, its sum s(x) 
which is, in general, a very complicated function, can be expressed 
-approximately by a polynomial; the accuracy of this approximation 
-can be as high as we please, provided we take a polynomial of a 
sufficiently high degree (7.e. the partial sum s,(«) with a sufficiently 
large 7). 


As with any other series of functions, we must at first study the 
region of convergence of this series, t.e. the values of x for which this 
-series will converge and the values for which it will diverge. We 
have noticed in the previous paragraph that the region of convergence 
of some series of functions can be represented by a set of very 
complicated structure; we shall now learn that region of convergence 
of a power series always has a very simple form which considerably 
simplifies the study of this class of series. 


351 
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The general form of region of convergence of a power series. 
depends on the following important property of series of this class. 


Theorem 1. Jf the series (1) converges for x = a, then it conver- 
ges absolutety for every value of x for which 


[x[<|al. 
Proof. {t follows from our assumption on convergence of the 
series 
Ay Te aye + age? +... ft ayu™ +... 


that a, «" + 0 for n — oo; this, in its turn, implies existence of a. 
number ¢ so that 


| anu” |<e (n = 1, 2,...). 
Let us now assume that} «|< {/«!, In that case whenn > 1 
1 ye |m x |? 
age | == | at lx a <¢ ie 





Since the progression 


is convergent, it follows from theorein | § 68 that the series 


co 


y) | nx” |; 


n=1 


is also convergent and this implies absolute convergence of the series: 
(i). The theorem is thus proved. 


The geometrical picture which illustrates theorem 1 implies 
that if the power series converges at a point a on the number line, 
then it will converge absolutely at any point closer to Othana. Let 
us now find the form of region of convergence of a power series in 
the light of theorem 1. 


1. Every power series (1) converges at x = 0, for at that point 
all terms except the first are equal to zero. Hence the point x = 0: 
belongs to the region of convergence of every power series, Can it 
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happen that the series (1) diverges for any x ~ 0, i.e. its region of 
convergence consists of a single point x = 0? The series 


T+ ox 22x? +3208 +o ttm + ., 
shows that this is possible; in fact, if x 4 0, then forn > 1/}x| 
sis ce Oe 


the n-th term of the series n"x" does not tend to zero for n > co and 
the series diverges. Hence the region of convergence of a power 
series can consist of a single point x = 0. 


2. The opposite limiting case arises when the series (1) conver- 
ges for every value of x, z.e. when the whole number line is its region 
of convergence; the fact that this case is also possible can be seen 
from the series 


nm 


* 23 n 
Leet St Rte tS te 


since we have for n > 2| x| 





7 
Qn nm “Qn 2 


therefore for every value of x the terms of this series have a smaller 
absolute value than the corresponding terms of a convergent geo- 
metrical progression for all sufficiently large x; this, as a result of the 
principle of comparison of series, proves convergence of the given 
series. 


3. In all other cases there exist values of x 4 0 for which 
the series (1) converges and other values for which it diverges. 
Let us at first prove that the region of convergence of the series (1) is, 
in this case, a bounded set. In fact, let « be an arbitrary point of 
divergence of the series (1); it then follows from theorem 1 that the 
series (1) should diverge for every value of x for which |x| > |«| 
and therefore each point of convergence of this series must satisfy the 
inequality 

lx] <][e@], 
which proves that the points of the set of convergence are bounded. 


Let us denote by 7 the upper bound of the set of points of con- 
vergence of the series (1), which exist as we have just proved. We 
say that the series (1) is absolutely convergent when |x|<randthat 
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it diverges when |x| > 7. The latter is evident from the definition 
of the number 7. Tofprove the former let us assume that |x| <7 
and that 


r— |x] =A>0O. 


Since 7 is the upper bound of the set of points of convergence of the 
series (1), a point of convergence y can be found such that 


yror—-A=|sI. 


It then follows from theorem | that the point x is a point of absolute 
convergence of the series (1), which was to be proved. 


Hence if the region of convergence of the series (1) is not res- 
tricted to a single point x = 0 and if it does not include the whole 
number line, then an 7 > 0 always exists such that the series (1) con- 
verges for | x| <r (i.e. in the interval (~ 7, + 7)) and diverges for 
|x| > 7 (i.e. outside that interval). 


So as not to exclude the other two cases which we have consi- 
dered above, it is always very convenient to consider in the first case 
the point 0 to correspond to the interval (— 7, + r) for, = 0 and in 
the second case the number line (or similar interval) for r = + co. 
Having accepted this we can formulate the result without exceptions. 


Theorem 2. There exists a number r(O Cr < + ow) for every 
power series such that the series converges absolutely for |x| <r and diverges 


for |x| > 7. 


The number r is said to be radius of convergence and the interval 
(— r, + 1) interval of convergence of the given series ; we shall consider 
somewhat later, whether this interval should be open or closed. 


We can thus see that region of convergence of power series is 
always an interval with centre at the point 0; in some cases this 
interval may reduce to the single point x = 0 or it may include the 
whole number line. Hence one of the basic problems in the theory 
of power series is to determine radius of convergence of the series (1) 
from its “coefficients” a, (n = 1, 2, ...). 


Modern science can solve this problem in the most general 
form, but we cannot consider this general solution here. We shall 
only consider one particular case which gives the desired result in 
many practical problems. 
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Theorem 3. Let the coefficients of the series (1) be such that 


l 
Sot) 

= |G, | asa 0; 

| 


tn that case 
(iL. 4 
ae fO<l<+o, 
eae a PE 
[0p l= em: 
Proof. LetO0 <1 < + ©; in that case, asn—> © 


ney ==, Ont 


| An 


a GC ntl ad 
an xt 














.[x|>l]ex], (2) 





and 
1 
lel< 4, isl <1; 


the series (1) converges absolutely at the point x-in accordance with 
the test 2 (corollary) § 68. Conversely, if 


Je] >>, I|x| > 1, 


ao 


the series » | a, x” | diverges at the point x in accordance with the 
n=] 
same test ;, it therefore follows that 


eed 
sah 


When / = 0, the relation (2) shows that for n > oo and for 
every x 

Any x" 

a 


> 0, 





and therefore, in accordance with the same test, the series diverges. 
for every x and7 = + ©. 


Finally when / = + 00, we have for every x 40 


1 
Ant % ae 


, jo © (n> 0); 
An x 








the series (1) diverges for every x # 0 andr = 0. . 
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Example 1. Let us consider the series 


where s is an arbitrary real number. Since for n > oo 


: tS (142) 1, 


ne 





therefore it follows from theorem 3 that the radius of convergence 7 of 
our series is equal to unity for every s. 


Example 2. Consider the series 





n=0 
When n > 1, d \ 
na ihins, : 
(n+ 1)! 1 
PEM 0 oe). 


é : n” , 
Hence the radius of convergence of the series eer is equal to- 
n=0 , 
r = + 00, i.e. the series converges for every value of x. 


Should the interval of convergence of the given series be open 
or closed? In other words, does the given series converge or diverge 
at the pointsx = — randx =r? 


These simple examples show that there is no single answer to 
these questions. Some series are convergent at both ends of the 
interval of convergence so that the closed interval (— r, +r) serves as 
the region of convergence; other series, however, diverge when x = r 
and x = — rand therefore the open interval (— 7, +1) is the region 
of convergence for these series; finally there also exist other series 
which converge at oné of the two ends of the interval of convergence 
and diverge at the other so that their region of convergence is the 
“‘semi-open”’ interval (— r, +7). 
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Let us now consider corresponding examples. 
Example 3. The series 


x 


x 2 xn 


has, according to example 1, a radius of convergence equal to unity, 
and it is therefore absolutely convergent at both ends of the interval 
of convergence. 


Example 4. The series 


x x? a” 
an aa ea +o. 
has, according to example |, a radius of convergence equal to unity. 
When x = — 1, we obtain the Leibnitz series 
re 1 
1 ics + aes oP as 


which, as we know, is conditionally convergent. When x=1, we 
obtain the (divergent) harmonic series. Hence the region of conver- 
gence of this series is the semi-open interval (— | <x < 1). 


Example 5. The geometrical progression 
Ptatott. txt... 


has a radius of convergence equal to unity and diverges at both ends 
of the interval of convergence. 


For further exercises cf. Problem Book by B.P. Demidovich, 
Section V, Nos. 125, 126, 132. 


§ 77. Uniform convergence and its consequences 


We have seen in the last chapter that uniform convergence has a 
great influence on different properties of series of functions. Having 
established the general form of the region of convergence of power 
series, we shall now naturally study uniformity of this convergence. 


Can we say that any power series 
Qo + yx t... banx™+ ... (1) 


is uniformly convergent in the ofen interval (—r, +1), where 7 is the 
radius of convergence of this series? We have already seen by an 
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example of a geomerical progression that this statement would not be 
generally valid. In fact, the series 


Ttatoet?t... pate... (2) 


has the open interval (— 1, +1) as its interval of convergence; the 
remainder of the series 





ntl 
ta(x) = be xh = Tce 
k=ont+l 


tends to zero as n —> oo irrespective of x(— 1< *< +1); however, 
no matter how large 2 be, 7,(x) > co for x + | and therefore no 
matter how n be, 1,(x) will be as large as we please, provided x is 
close to unity; hence convergence of the series (2) in the open 
interval (— 1, + 1) is non-uniform. 


However, the power series converges uniformly in any interval 
which, together with its ends, lies within the interval of convergence, 
as is shown by the following theorem : 


Theorem 1. Jf ris the radius of convergence of the given series and if 
O<r' <7, then the series (1) is uniformly convergent in the interval 


(—1', +7"). 


Proof. Since r’ < r, the series (1) is absolutely convergent at 
the point x = 7’, 7.¢., the following series converges 


foe] 
Pay les 
n=l 


but when | «| < 7’, we have: 


| ane? d Slay fe (nee 125-5:5), 
and it follows from theorem 2 § 73 that the series (1) converges 
‘uniformly in the interval | x| <r’; theorem | is thus proved. 


This theorem has many corollaries which are all important in 
the theory and applications of power series. At first it follows that 


Theorem 2. The sum of a power series is continuous at every interior 
point of the interval of convergence. 


In fact, every interior point of the interval of convergence 
can be confined with in an interval which, together with its ends, lies 
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within the interval of convergence. It follows from theorem 1 that 
the series will converge uniformly within this interval and, according 
to theorem 1! § 74, its sum is continuous. 


Moreover, owing to the fact that a uniformly convergent series 
of continuous functions can always be integrated term-by-term 
(theorem | § 75), it follows from theorem | that 


Theorem 3. Af any interior point x of the interval of convergence of 
the series (1) 





¥ ao x foe} 

oe = Ot gat 
[so au Vian [unde ea ; 
0 n=0 O n=0 


where s(x) denotes the sum of the series (1). 


As we know (theorem 2 § 75), this last series is uniformly con- 
vergent in any interval in which the series (1) is uniformly convergent ; 
hence it is also uniformly convergent in any interval which completely 
belongs to the interval of convergence of the series (1). 


Finally, the following proposition which establishes the possi- 
bility of term-by-term differentiation of a power series within its 
interval of convergence is of fundamental importance in the theory of 
power series and in all its applications. 


Theorem 4. The sum s(x) of the power series (|) is differentiable at 
every point inside the interval of convergence (—r, +1) of this series ; the series 


na px", (3) 


ipae 


n 


obtained as a result of term-by-term differentiation of the sertes (1), has the 
same radius of convergence r and its sum is equal to s’ (x) (|x| <1). 


Proof. Let the numbers p and Pf’ satisfy the inequality 
0<p<pe’ <~r. It follows from example | § 76 (s = 1) that the 


series 
co 


> nA 
n=1 


is convergent for 0 < A < 1 so that assuming 
A= 


é 


P 
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we have : 
fe) nr 

n & > 0 (n> o), 
and therefore there exists a number n independent of ¢ > 0 such that 

fe) n 

n (4) <6 (eS -L, ae 

Having established this result we now note that 

1] n 7 ¢ f 

nla,|e"™t= “ees (=) lan|e ree a 


since e’ < 7, the series 


co 


layers 
1 


Ef od 


is convergent; but in this case the last inequality shows that the 
series (3) is also (absolutely) convergent for x =e. And since.p can 
be as close to ry as we please, the radius of convergence R of the 
series (3) is not less than r. Hence theorem 1 shows that the series 
(3} is uniformly convergent in any interval -p<x<pifO0<pP<r. 
But in this case we can maintain on the basis of the general theorem 
3 § 75 that the function s(x) has a derivative equal to the sum of the 
series (3) for -— <x <r. Yo conclude the proof of theorem 4 it 
only remains to show that R= 7. This follows from the fact that 
the series (1) obtained as a result of term-by-term integration of 
the series (3) from 0 to x should, according to theorem 3, converge 
for — R < x < R; therefore r > R; and since we have already found 
that R > 1, therefore R = r, and theorem 4 is proved 


Many important and far-reaching conclusions can be drawn 
from this theorem. At first this theorem shows that the sum s(x) of 
a power series within its interval of convergence is always not only 
continuous but also differentiable. And since in this case the function 
s’ (x) appears to be the sum of a power series with the same interval 
of convergence ( 7, +7), we can again apply theorem 4 to this 
function. This shows that the second derivative s” (x) of the function 
s(x) exists at every interior point of the interval ( —7, +r) and 
is the sum of a power series resulting from the second term-by-term 
differentiation of the series (1). It is obvious that this argument can 
be continued ad infinitum and it leads to the following general result: 
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Theorem 5. Jf r is the radius of convergence of the series (1), then its 
sum s(x) has derivatives of all orders at every interior point of the interval 
( — 7, + 17) and the function s™ (x) (n = 1, 2, ...) is the sum of the power 
series obtained as a result of n lerm-by-term differentiations of the series (1) 
and has the same radius of convergence r: 


s(x) = » K(k — 1)... (kK —n + Iayx*™(-—r<x< +r) (4) 
k=n 


For exercises to § 77 cf. Problem Book by B.P. Demidovich, 
Section V, Nos. 191, 192, 226, 200. 


§ 78. Expansion of functions into power series 


We have so for only investigated series which were given to us; 
we have found their region of convergence and studied the properties 
of their sums. However, in applications we are frequently dealing with 
the converse problem; we are given a function s(x) and it is requied 
to find if this function can be sum of a power series in the given 
interval (or, as it is usually said, if it can be “‘expanded into a power 
series’); if an expansion is possible, the question arises to find the 
coefficients of this series and determine its radius of convergence. 
We shal]l deal with these problems in this paragraph. 


At first theorem 5 § 77 shows that the function s(x) can be 
expanded into a power series if this function has derivatives of all 
orders at every point in the given interval (which we can assume to 
be of the form ( — 7, + 7), 7 > 0). This considerably narrows down 
the class of functions which can be expanded into power series; 
however, we must keep in mind that all elementary fuctions satisfy 
this requirement and, therefore, from a practical point of view, this 
condition is not so restrictive. Let us assume that the function s (x) 
satisfies this requirement, i.e there exist s™ (x) for every n > 0 
(s (x) = s(x)) and for every x( —r<x< +r). If s(x) can be 
expanded into a power series 


s(x) = Di apet, (1) 
k=0 


then, as we know, the relation (4) § 77 would hold for the function 
s™ (x)(n = 0, 1, 2,...). If x = 0, this relation gives : 


gi (0) = ni an (n = 0, 1, 2, 2%) 3 
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hence 


s™ (0 
pe aw (05 Ny De cea (2) - 

Thus the coeffictents an of the power series whose sum is the function - 
s(x) are uniquely determined in terms of this funceion by means of formula (2). 


This result is of great theoretical and practical importance. It 
shows from the theoretical point of view that every function s (x) can 


have only one power series whose sum in an interval is equal to s(x) ; 
in other words, two power series which converge in a given interval ’ 
always have different sums in that interval. From the practical point 
of view this result enables us to calculate readily and easily the coeffi- 
cients of the power series represented bys (x); evaluation of derivatives 
of all orders of this function at the point x = 0 is only necessary for 
this purpose. 


Hence if the function s (x) can be expanded into the power 
series (1), this series always has the form 


foe) 


(k) 
Oe yee (3) 
k=0 


The series (3) for this function is known as the Maclaurin series 
of this function regardless of its region of convergence and irrespec- 
tive of whether its sum does or does not coincide with the function 
s (x). Hence every function with derivatives of all orders at x = 0- 
has a Maclaurin series; evidently this does not yet solve the problem 
of expanding the function s (x) into a power series, since 1) the series - 
(3) may be divergent for every x 4 0 and 2) if this series converges, 
its sum may be a function other than s (x). All that we know so far 
is restricted by the fact that ¢f the function s(x) can, in general, be ex- 
panded into a power series, this series should be its Maclaurin series. 


However, this restricted result is very important. Until we 
have obtained this result, we could not find expansion of the function 
s (x) into a power series, for we had no information about the coeffi- 
cients of a possible series of this kind ; now we are already studying 
a definite concrete series (3) and we must find its region of conver- 
gence and also find whether its sum coincides with the function s (x). 

-in this region. 
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We have already met the partial sums s,, (x) of the Maclaurin 
series in Chapter IX and at that time, as also now, we were interested 
in finding the difference s (x) — 5, (x). However, our new problem 
differs essentially from the old one. In Chapter IX we were not deal- 
ing with infinite series ; we were only interested in finding the differ- 
ence s (x) — 5, (x) for a constant n and a sufficiently small x, and for 
this purpose we developed different special expressions for the quan- 
tity s (*) — s_, (x) =r, (x) which we called the “last term” of the 
Maclaurin formula. Now we are mainly interested in convergence 
of the series (3) with regard to the function s (x), z.e. we are interested 
in finding the same last term 7, (x) for the given x and n>» oo. The 
special expressions for the last term developed in Chapter IX can also 
be used in this new problem. We shall have many examples of this 
kind later. At present we must emphasize again that in order to 
establish possibility of expanding the function s (x) into a power series 
we cannot be satisfied by existence of derivatives of all orders for this 
function alone but we must also prove that the Maclaurin series is 
convergent (which is very easy); we are compelled to study the 
behaviour of the difference 





s‘(0) 
! 


a (n) 
Tn (x)=s («=| 5 (O)+ ri oo (0) oy pie) a | 


2! a n! 

asn-—»> co. In fact, it can happen that the Maclaurin series cons- 
tructed for the function s (x) is convergent, but its sum is other than 
s(x). For this purpose let us consider again the function which we 
have considered in § 41: 


= gar (x 0), 
et= ] ee, 


for which 9™ (0) = 0 (nxn = 0, 1, 2,...). If the function s (x) can 
be expanded into the power series (1) (which, as we know, coincides 
with its Maclaurin series), then the function 


s* (x) = 5 (x) + ae (2), 


where « is an arbitrary constant real number, evidently has the same 
Maclaurin series as the function s (x); according to our proposition 
the sum of this series is equal to s (x) and is therefore other than 
s* (x) (ifa #0). We have seen above that the power series into 
which our function can be expanded is uniquely determined (as its 
Maclaurin series) ; now we see that, conversely, one and the same series 
can serve as the Maclaurin series for an infinite number of different functions. 
if the sum of the series is equal to one of the functions of this family, 
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then the Maclaurin series of any other function f (x) belonging to 
the same family will be convergent, but its sum will be other than f (x). 


Let us finally remark that we have mentioned at the beginning 
of this chapier series of the following type : 


Ay t+4,(x—a)+aq(x—a)? +... pay (x—a)*+..., (4) 


where a is a constant real number; the substitution of the variable 
x = a+» transforms this series into the simpler form of a power 
series 


wo 


ba any”; 


n=0 


therefore all properties of power series established above can be 
extended with slight modifications to series of the type (4). The 
region of convergence of the series (4) is always an (open, closed or 
semi-open) interval of the form (a —r,a+7r)(O0<r<g+ oo). If 
5 (x) is the sum of the series (4), then s '") (x) exists for every 2 > 0 
and for every x (a --r <x < a+ r) and 


gp {a) . 
= ae (n = 0, 1, 2, -++)s 





n 


so that the series (4) is Taylor’s series for the function s (x) : 
s(2)=5(2) + 19 (ea) OO ape... Heat 


We shall now consider how some other important elementary 
functions can be expanded into power series. In many cases the 


possibility of this expansion is established by means of the following 
general proposition : 


Theorem 1. Jf there exists a positive number such that 
Een Co) oa OGM ne eer ae <r ae 0 rs 


then the function s (x) can be expanded into a power series in the interval 
—rix<cnr. 


Proof. We have seen § 39 that the last term of the Maclaurin 
series can be represented in the form 





ln (x) = 


ttt 
ce ij 5D (px) (0<6< 1). 
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Hence when — r <we <y, 


Crt. 
tTralx)| < (+i)! 


n 
But for any 7 >. 0 we have — —'0 (n> co); this follows directly, 


say, from the convergence of the series 





ao yn 
nt 
n=0 
(example 5 § 76). Therefore when — 7 <x <7, 
Tn (x) > 0 ‘(n> 00), 
and, consequently, 
5 (0 
(x) = )) 0) “" (—r<x<n), 
n=0 


which proves theorem 1. 
For the functions s(x) = sin x and s(x) = cos x we have: 
(s(x) | <1 (-o <e << +o, 2=0,1, 2, ...); 


these functions can therefore be expanded into power series which: 
converge along the whole number line. 
For the functions s(x) = e* we have in any interval —r<x<r 
[s™ x) l =r < ef (0s 1. 26249) 2 
hence the functions e* can be expanded into a power series for 


~—r <x* <rand therefore also along the whole number line, since 
the numberr > 0 is arbitrary. 


We know from § 39 the coefficients of the Maclaurin series for 
the functions sin x, cos x and e*; therefore we can simply write : 


ee: x x oe 
sine = Tp — 3p + 3p + (—1) On+j + oy 
x x . yen 
cosx=1— or +- qa ECT) (Qniyh Tote 
x x x” 
eres sts ap aie agg ae ees i 
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For the function s(x) = 1/(1 +.) we have for x > — 1 
ni 
1s (x){ = (tse —> 00 (n —> 00), 
and theorem 1 does not hold. We know, however, that the Maclaurin 
series for the function s(x) 
l—x+x— 4+... 


has a radius of convergence equal to unity and its sum is equal to 
s(x) for|x|< 1. Owing to the fact that for x > — 1 





x 
du 
j4-8 (1 + x), 
0 


it follows from theorem 3 § 77 that we have for -- 1<*« <1 





d —])" ynti 
In (l+x) = ie = Yaa] wd = yee = 
0 =O 0 n=0 
x Ea 3 n 
Se gf a ay Sobaes 


the radius of convergence of this series is equal to unity (cf example 
4 § 76); hence the function In (1 -++ x) can be expanded into a power 
series only in the interval (—1, +1). Similarly the series 


whose radius of convergence is unity, can by means of integration be 
expanded into the following series 


co 
arctan x = yee De ha aie 


ee ae eg Pe ee 








eas 


n=0 
-which is also convergent in the interval (—1, +1). 


We have obtained expansions of the functions In (1 + x) and 
arctan x into power series by means of the same method and both 
these series converge only in the interval (—1, +1). However, there 
is an essential difference between them. ‘The fact that the expansion 
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of the function In(1 + x) cannot be continued beyond the interval 
(~—1, +1) is intelligible, since the functionIn (1-+-x)->— o for x>— 1 
and In (1 + x) is void for x < — 1; on the other hand, the function 
arctan x is defined and has derivatives of all orders along the whole 
number line; nevertheless, its expansion into the Maclaurin series is 
possible only in the interval (—1, +1). 


Finally, let us consider expansion of the function s(x) = (1 + «)% 


into a power Series, where « is an arbitrary constant real number. 
We have : 


s™ (0) =a(a — 1)... (a —n2 + 1), 


which gives us the following expression for the coefficicnts of the 
Maclaurin series for the function s(x) : 


a (ee ae 1) 


ni 


(f= 0.1 2 cas). 

If « is zero or a natural number, then all a, vanish from a certain 
number onwards, and the resulting Maclaurin series simply coin- 
-cides with Newton’s binomial formula. However, for all other values 
of « the coefficients a, are non-zero and we obtain an infinite series. 
We can evidently restrict ourselves and only consider this case. 


Since 


Qnty _ |%& — 7 
a, | (n+l 





> | (n —> oo), 


‘therefore, according to theorem 3 § 76, the radius of convergence of 
‘the Maclaurin series for the function s(x) is equal to unity. Hence 
beyond the interval (—1, +1) this function cannot be expanded into 
a power series. We will now show that expansion is possible in 
‘this interval, 7.e. when | x | < 1, 


ee y a(%—1)...(x—n+1) 


n! 


f= (las 
a=1 


For this purpose we shall use the expression for the last term of the 
Maclaurin series obtained in § 39 : 


os n ntl 
T(x) = a ~ $40 (9 x), 


where 0 < 9 <1. In our case 


gM) (x) = a (ao — 1)... (2 — nl +x)", 


368 A COURSE OF MATHEMATICAL ANALYSIS. 


and consequently 


(1 = 6)” gett 
nl 


Tn (x) = a(a — 1)... (@ —n)(1 + Gx)e- et = 


_— (#-1) @—2) ..(*#-lon+) ,, 


ni ax (1-+6x)*+ 


(Ry 
Since x > — 1, thereforeO < 1 — 9 <1 + Ox and 
ae <1; 


further, @ only depénds on n in the expression ax (1 -+ §x)*1; but 
since we always have 0 < @ < 1, the expression | «x(1 + 6x)*"?| is 
always confined between the sositive numbers 


ax|(1+4x))*tand|ax| (1 —[ x), 


which are independent of n; hence denoting by & the larger of these 
two numbers we have for every n 


pax (1 + @x)%-1| <&. 
We thus obtain the evaluation 


ei 1) (es 2). Sag 
nN. | 


5 


on the right-hand side the coefficient of k represents the absolute 
value of the n-th term of the Maclaurin series for the function 
(1+x)%1; but we have shown that this series converges for every 
index if | x | <1; therefore the n-th term of this series should tend 
to zero as n —> oo and we obtain 


t(*)>0 (n> o), 


which was to be proved. 


In conclusion to this paragraph we shall review once again (ina 
condensed form) the expansion of several important transcendental. 
functions into Maclaurin series : 


= Jat (—o< x<4+oo).. 


sing = D(— Uo ny (—0< x <4). 
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ao 





J2n 
cosx = )) (— IY Ga (—o< x <+0). 
n=0 
+1 
In(I+x) = )) (= ee (—1< x <1)*). 
n=0 
-2nt1 
arctans = y (—1)" I (—1< x <])*). 
n=0 





eee ees y a(a — 1) aoe See Gs (—l< x <1)*). 
n=1 


These expansions occur frequently in applications and they 
must be remembered by heart like tables of derivatives or tables of 
primitives of simple functions. 


For exercises to § 78 ¢f. Problem Book by B. P. Demidovich, 
Section V, Nos. 140-143, 149-154, 163, 169, 171, 173, 178, 187, 189. 


§ 79. Series of polynomials 


We have already said that one of the main advantages of ex- 
panding functions into power series is the approximate representation 
of these functions in terms of polynomials. In fact, if an arbitrary 
function f (x) can be expanded into a power series which converges 
uniformly tof (x) in the interval (a, b), then for « > 0, which can be 
as small as we please, and for a sufficiently large n we have 


If(x) —sn(xs)]<e (ag % < d), 


where 5, (x) are the partial sums of the power series, which are there- 
fore polynomials. Jn this connection it is important to note that the 
theory of power series not only enables us to establish possibility of 
the approximate replacement of functions by polynomials but also 
makes it possible to find these polynomials by expressing their coeffi- 
cients in terms of the function f (x) and its derivatives at x = 0. 





*) The behaviour of the series shown above at the ends of the interval of 
convergence can be established by a more detailed investigation which we do not 
give here. 
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Thus if the expansion of a function into a power series makes 
it possible to express it approximately in terms of polynomials of a 
sufficiently high degree with as great an accuracy as we please, it is 
equally interesting to find if the converse proposition is also true; we 
already know that a comparatively restricted class of functions can 
be expanded into power series; for example, such functions must 
have derivatives of all ordcrs, and even this restrictive condition is 
not sufficient. If uniform approximation in terms of polynomials with 
as high a degree of accuracy as we piease could only be applied to 
functions which can be expanded into power series, the scope of these 
approximations would become very restricted. 


We shall now agree to say that. the function f(x) permits uniform 
approximation in terms of polynomials in the interval (a, b,) if there exists 
a polynomial P (x) for arbitrarily small « > 0 such that 


[Pes P Gy ee as ae 5), 


We have already séen that a function which can be expanded 
into a power series permits uniform approximation in terms of poly- 
nomials in every, interval which lies entirely within the interval of 
convergence of the given series. However, a power series is a parti- 
cular case of a series of a more general type 


AC) (1) 


whose terms are composed of arbitrary polynomials P, (x). Let us 
assume that the series (1) converges uniformly in the interval (a, b); 
let us denote its sum by f (x) and its partial sums by s, (x). Accord- 
ing, to the definition of uniform convergence we have a value of n 
for every « > 0 such that 


If (*) ~ sn (x) | <e (a<a <b), 


and since s, (x) is the sum of a finite number of polynomials, it is also 
a polynomial, and therefore it implies that the function f (x) permits 
uniform approximation in terms of polynomials in the intcrval (a, b). 
Hence a function which can be expanded in a subinterval into a 
uniformly convergent series of polynomials permits uniform approxi- 
mation in terms of polynomials in that interval. However, it can 


be readily seen that the converse proposition is also true. In fact 
2 


let the function f (x) permit uniform approximation in terms of 
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polynomials in the interval (a, 5). In that case for every natural 
number'n a polynomial Q,, (x) can be found such that 
1 
FQ —-Q.Wl<> @<x<d. (2) 


n 
a 
Let us assume that 


Py (x) a Q1 (x), Dy (x) = Qn (x) = Qn (x) (n an 


in that case the partial sums of the series 


Ps (x) 


n=1 


will be expressed by the polynomials Q,, (x) and, the inequality (2) 
shows that this series converges uniformly in the interval (a,b) and 
its sum is equal to f (x). 


Hence uniform approximation of the function f (x) in terms of 
polynomials in the interval (a, 6) is equivalent to the fact that the 
function f («) can be expanded into a uniformly convergent series of 
polynomials in that interval. We must now establish which functions 


permit this expansion. 


At firstit is obvious that this function must be continuous in the 
interval (a,b); in fact, since all polynomials are continuous functions, 
therefore (according to theorem 1 § 74) the sum of a uniformly con- 
vergent series of polynomials in the interval (a, 6) must also be conti- 
nuous in that interval. One of the most fundamental theorems of 
mathematical analysis is the converse fact discovered in the second 
half of the last century (by the German mathematician Weierstrass) 
that every function which is continuous in the interval (a, b) permits uniform 
approximation in terms of polynomials in that interval (or, what is the same, an 
expansion into a uniformly convergent series of polynomials). Hence by 
passing from power series to the more general type of series of 
polynomials we considerably enlarge the class of functions which can 
be expanded into such series; if it was carlier necessary that a func- 
tion should have derivatives of all orders, itis now no longer necessary 
to assume existence of even the first derivative. 


The theoretical and practical applications of Weierstrass’ 
theorem are so great that many different proofs were proposed for 
it from the time of its discovery; these proofs can be divided into 
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two groups: one group uses the properties of one or other special 
analytical apparatus in order to establish the theorem, while proofs 
of the second group are based on general considerations. Both 
groups are very instructive, for the arguments used in this connection 
find many applications in other analytical problems. In the next 
paragraph we give one of the simplest proofs of the first group ‘pro- 
posed by Academician S. N. Bernstein. 


§ 80. Theorem of Weierstrass 


Theorem. The function f(x) which is continuous in the interval (a,b) 
permits uniform approximation in terms of polynomials in that interval. 


Proof. 1. All proofs of this basic theorem which rest on a 
special analytical apparatus require the preliminary elucidation of 
the properties of this apparatus. Therefore we must also in t .is case 
begin by giving the proof of an auxiliary elementary algebraic 
inequality. 

Lemma. For every natural number n and for every x the following 


inequality holds*) ~ 


n 
y} Ch (k— nx? xk (1 — xr ts a 
k=0 


Proof. Newton’s binomial formula gives us identically with 
respect to z: 


n 
Ge aU aa (1) 
k=0 
differentiating with respect to z and multiplying by z this gives 
n 
eee . 
k=0 
the repetition of the same operation gives : 
n 
y BCR = nz (1 + 2) 4+ n(n — I)z? (1 +z)? ?= 
k=0 





*) Here and in future we shall assume that x* = 1 forx =O and k = 0; 


similarly when x = 1 and k =n, we assume that (1 — x) "-* = 1, The numbers 
C*,, are binomial coefficients with their usual combination notation. 
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=nz(l+zyrFr{l+z2+(a— z= 
= ng (1 + ne)(1 + 2-9; 
assuming in the relations (1), (2) and (3) that 


re: 
: l—x 


and multiplying by (1 — x)" we obtain for x # 1: 


n ' 
i ata — ar = 1, 
k= 


n 
» KCK xk(1 — x)"-* = nx, 
k=0 
n 
» k2CK xk (1 — xk = nx (1 — x + nx), 
k=0 


(4) 


(5) 


(6) 


and a test shows that the equations (4), (5) and (6) are also valid for 


x= 1. 


Let us now add term by term the identities (4), (5) and (6), 
having multiplied the first by n?x? and the second by —2nx. This gives : 


n 
Y) (ntx® — Qnxk + 2) Chxt(1 — x) = 
k=0 


= nx? — Qn®x? + nx(1 — x + nx), 


or 

n 

> (k — nx)? Chxk (1 — x)"-* = nx(1 — x), 
= 


and since for every real x 


1 


x(1 — x) Sy 


therefore the lemma is proved. 
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2. We shall now proceed to prove the theorem and begin by 
assuming that the given interval (a, 4) is the interval (0, 1); we 
assume that for every natural number n we have : 


¥ ¢(4) CE gk | — xjn-k = B, (x); 


nh 
k=0 


B, (x) is evidently a polynomial of a degree not higherthan n*). We 
shall now note that B, (x) > {(x) asm — co uniformly in the interval 


(0, 1). 


Let us denote by M the upper bound of the function | f(x) | in 
the interval (0, 1). Let ¢ be an arbitrary positive number so that the 
function f(x) is continuous (and therefore also uniformly continuous) 
in the interval (0, 1); there exists a positive number 56 in this case 
such that when 


|x — | <5,0cy <1O<e <1, 


we have 


Lf Gi) =F Oa) P<: 


Our immediate problem is to find the difference | B, (x) — f(x) | 
for0 <* <1. It follows from formula (4) that for every x 


f 


n 


Y f(s) Chak (= ay = fla), 
k=0 


which makes it possible to write the difference B, (x) ~ f(x) in a form 
convenient for evaluation 


n 


Bw) — f= 4 (F)-s@ J otsta—aes 


hence forO <x < 1 





P.@)—SO1<P[ F(=)-s@| ae a-9_ 7) 
k=0 





*These “Bernstein polynomials” By, (x) make the special analytical apparatus 
whose properties are used in the above proof. 
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Let us divide all the numbers k (0 < & <n) into two groups : 
the group (A) contains the numbers & for which 
k | 
eee 


= x) <8, (A) 





and the group (B) contains those numbers & for which 


= —xl>6; (B) 


hence in the inequality (7) y is correspondingly broken up into two 
k=0 


sums which we denote respectively by La and ds. According to (A) 
we have in every term of 2a 


£(5)-f) 


<¢, 





and therefere 


n 
ie ‘op . 
ye <e PF Chak — x) <e y Chm (1 — x)t#ae (8) 
k=0 


But in every term of the sum Zs we have : 
3 ee ey ee 

(k — nx)? > n?8*, S(E)-s0) < 2M, 
and therefore 
az), (& — ma)? Chat (1 — x) A < 

n 
2M os 
< 7252 yh (k — nx)" CF xh (1 ~— x)™* ; 
k=0 

hence it follows from the above lemma that 


M 
D <2 o 


Finally we obtain from (7), (8) and (9) : 


M 
B@-f0O1<Y, + Ly <et ae 
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Pe M 
if n is so large that DnB? < ¢, then 
| B, (x) — f(x) | < 2e (0<*«* <1). 


and since « > 0 is arbitrarily small, we have uniformly in the interval 


(0, 1) 


Br(x) >f (x) (n> 0), 
which was to be proved. 


3. The extension of this theorem proved for the interval (0, 1) 
to an arbitrary interval (a, 6) (a < 5) involves no further difficulties. 
Let the function f(x) be continuous in the interval (a, 6). If we 
assume that x = a + (6 — a), then y= (x — a)/(4 — a) so that » 
traverses the interval (0, 1) while x traverses the interval (a,b). Let 
us assume that 


f(x) =fla + (6—-a)9] = 2 Ly) (O<» <1). 


It is evident that the function ? (y) is continuous in the interval 
(0, 1). Therefore no matter how small «e > 0 be, it follows from the 
proved theorem that there exists a polynomial P(y) such that 


|P(y) — P(y)[<e (9<» <1), 


or, what is the same, 


fO=2 Ge) 


a 





<€ (a<x<b); 








but P ((x — a)/(b — a)) is a polynomial of the variable x which for the 
sake of brevity can be denoted by Q(x) so that 


If) -Qls)|<e¢ @<x<b); 


since ¢ is an arbitrarily small number, this implies uniform approxi- 
mation of the function f(x) in terms of polynomials in the interval 
(a, 6). This proves the fundamental theorem completely. 


We already know that this theorem is equivalent to the 
following statement : every function f(x) which is continuous in the interval 
(a, b) can be expanded into a series of polynomials which is uniformly conver- 
gent in that interval. 


CHAPTER XXI 
TRIGONOMETRICAL SERIES 


§ 81. Fourier coefficients 


In this chapter we shall consider the theory of the so-called 
trigonometrical series; this is a class of series, which, after power series, 
is most important both in theory and application. A trigonometrical 
series is a series of the type 


wo 
a : 
Ft Yin cos nx + b, sin nx), (1) 
n=1 
where 49, 441, @o, ... ; 04, bg, .«.. are constant real numbers called the 


coefficients of the series (1). We shall see in this chapter that the 
properties of trigonometrical series are very different from those of 
power series and they are in some respects a more complicated and 
bulky apparatus for the study of functions they represent ; however, 
in other respects they possess many advantages over power series. 
We cannot generally say which of these two classes of functions 
deserves precedence. ‘The answer depends at first on the form of the 
function which is being studied and also on the problems which have 
to be solved with regard to this function. We already know that in 
order to represent a function by a power series it is necessary that 
this function should have derivatives of all orders; on the other hand, 
in order to expand a trigonometrical function into a power series it is 
sufficient, as we shall soon learn, that the first derivative should exist 
and be continuous*) ; thus the class of functions consisting of trigono- 
metrical series is much wider than that of power series and this 
considerably increases the significance of trigonometrical series ; on the 


*) and even this condition is not always necessary. 
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other hand, as we know, the region of convergence of a power series 
always has a very simple form; it is an interval with centre at the 
point O. But the region of convergence of a trigonometrical series 
is generally a set of a very complicated structure and very sensitive 
methods are needed for its study, which we cannot consider in this 
book. In this respect power series have an advantage over trigono- 
metrical series. 


If we increase or decrease the variable x by 27, then all terms of 
the series (1) evidently remain unchanged; if the series is convergent, 
its sum will not be affected, hence the sum of the series (1) is always 
a periodic function with a period 27; if the function /(x) does not 
possess this periodicity, it can be represented by a trigonometrical 
series only in an interval less than 2x. This restriction is not 
necessary and can be readily avoided by a very simple method, as we 
shall see later. On the other hand, while studying trigonometrical 
series periodicity of its terms evidently enables us to confine ourselves 
to an arbitrary interval 2x in length; xin such cases we usually take 
the interval — 7 <« <7, 


The system of functions 
1, cos x, sin x, cos 2x, sin 2x, ... (2) 


which forms the basis of every series of the type (1), possesses one 
remarkable property which holds the main key to the theory of 
trigonometrical series and is the source of almost all advantages of 
this apparatus. This property is due to the fact that any two functions 
of the system (2) are mutually orthogonal in every interval 27 in length. 
The functions f(x) and f2(x) are said to be mutually orthogonal in the 
interval (a, b) uf 


b 
[AW Sel)ae = 0. 


If we have a (finite or infinite) system of functions in which any 
two functions are mutually orthogonal in the interval (a, 6), then this 
system is said to be an orthogonal system in that interval. In order :to 
prove that the system of functions (2) is orthogonal in evcry interval 
2x in the length, it is evidently sufficient to show that 


d 


| cos mx cos nxdx = 0 (mA n;m,n = 0,1, 2, ...), 
—T 
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© 


[ sin mx sin me dx = 0 (m Ans m, n= 41,2, <2 ), 


qT 
[ cos mx sin nx dx = 0 (m = 0, 1, 2, ...;.2 = 1, 2, ...); 


but 
1 
COS mx COS nx = “x {cos (m + n)x + cos(m — n) x}, 
P : 1 
sin mx sin nx = 5 {cos (m — n) x — cos (m + n)x}, 
; Pegg 
cos mx sin nx = > {sin (n + m)x + sin (n — m) x}. 


Hence the above three integrals can be written in the form of 
the following integrals 


™ Tk 
| cos kx dx, | sin lx dx, 
_T —_—TT 


where the integer & is non-zero and the integer / is arbitrary; both 
integrals vanish, as can be readily shown by a simple calculation. + 


The property of orthogonality of systems of functions makes 
them a very convenient instrument in mathematical analysis, so that 
functions much more complicated than those entering the system (2) 
can be conveniently studied provided they form an orthogonal system. 
Modern science knows and uses many orthogonal systems and their 
theory is usually constructed on the lines of the theory of the system 
(2) and related trigonometrical series. 


In order to demonstrate the first simple application of orthogo- 
nality of the system (2) we shall now consider a problem for trigono- 
metrical series which is analogous to a problem solved earlier for 
power series: assuming that the function f(x) can be expanded into the 
trigonometrical series (1), find the coefficients ay, by of this series. 


Let us assume that the series (1) is uniformly convergent in the 
interval (—z, x) and owing to periodicity also on the whole number 
line and that its sum is equal to f(x) so that we have 
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f(x) = 2 + Vi (azcos kx + bysin kx) (—n<x<n). (3) 
k=1 


Let n be an arbitrary natural number. Let us multiply all terms of 
the series (3) by the same function cos nx; the new series so obtained 
also converges uniformly in the interval (—z, 7), since the remainder 
of this series is equal to r;, (x) cos nx and its absolute value does not 
exceed the remainder r, (x) of the series (3); the sum of the new 
series is evidently equal to f (x) cos nx, so that we have : 


ao 
a 


2 


cos nx-+ Vaz cos kx cos nx-+ 6; sin kx cos nx) 
k=l 


f (x) cos nx= 


(—z Cx <7z). 


It follows from theorem | § 75 that this series can be integrated term- 
by-term in the interval (—7x, x). The integral of the left hand side is 


[rs (x) cos nx dx. 


As a result of orthogonality all the integrals on the right-hand 
side are equal to zero except the integral 


Tt 
cE n cos? nx dx 
Tr. 
of the term of the series for which k = n; hence as a result of term- 


by-term integration we obtain 


Tw 


[sr cos nx dx =| an Cos” nx dx, (4) 
—_—T —T 
But cos? nx = 1/2 (1 + cos 2nx), therefore 


1 


Tw wv 

1 
i cos” nx dx = ay {| dx + =| cos 2nx ax | = Td ie 
—T —T 


—T 


a 
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Thus the equation (4) gives : 


[ro cos nx dx = Tan; 


—t 
and consequently 
a ~L/ ) d: k.2 | 
= J (x) cos nx dx (n= 1, 2,...). (5) 
—T 


Similarly by multiplying all terms of the series (3) by sin nx and 
integrating term-by-term in the interval (—7, =) we obtain 


by, = =| ro) sin nx dx (n= 1, 2,...). (6) 


Finally, term-by-term integration of the series (3) itself in that same 
interval gives : 


wT 
fre dx == Gy; 
ase ; 

and therefore 


wT 
1 ‘ 
ay == | f(s) des ) 
—T 
formula (7) can be regarded as a particular case of formula (5) for 
n = 0; in order to emphasize this generality the constant term of a 
trigonometrical series is usually denoted by a,/2 and not by ay. 


The formulae (5), 6), (7) completely solve our problem, for they 
enable us to find the coefficients a, and 6, when the given function 
Jf (x) (the sum of the trigonometrical series) is known, provided the 
series is uniformly convergent. 


As with power series, we can see that these coefficients are 
uniquely expressed in terms of the function f/ (x) ; hence there ts only one 
uniformly convergent trigonometrical series whose sum is equal to the given 
function f (x). In contrast to power series where the expressions of 
coefficients require existence of derivatives of all orders of the function 
f(x), we can now see that the formulae (5), (6) and (7) are not 
required to be expanded any more beyond its properties mentioned 
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in the statement of our problem; in fact, it follows from uniform 
convergence of the series (3) (which we have assumed from the 
beginning) that the function f(x) is continuous (and hence also 
integrable) (this also implies integrability of the functions f (x) cos nx 
and f (x) sin nx); in order that formulae (5), (6) and (7) should be 
valid nothing but this integrability is required. 


The numbers ay, 6, expressed in terms of the function f(x) by 
means of the formulae (5), (6), (7) are usually called lourier coefficients 
of this function (in spite of the fact that the formulae (5) (6) and (7) 
were founded by Euler long before Fourier). Hence for every func- 
tion f (x) which is continuous in the interval (--x, =) we can, by 
using these formulae, make the complete series of Fourier coefficients 
Ao, 41, Ae, «> by, bg,.--3 in this event the series (1) in which the 
numbers so determined serve as coefficients is called the Fourier series 
of the function f(x) ; in short, every function f (x) which is continuous 
in the interval (—7x, m) has a Fourier series. However, as in the case 
of power series, no conclusions can be drawn from the possibility of 
expanding the function f(x) into a trigonometrical series. The 
Fourier series for the function f(x) may be divergent for some (or ° 
even all) values of x. Moreover, even if we assume that this series 
is divergent for all values of x, we have no grounds to believe that its 
sum coincides with the function f (x). Hence the question of what 
properties the function f (x) must possess in order that it should be 
the sum of its Fourier series requires special study. At present we 
only know one thing: if a trigonometrical series does, in fact, exist 
and converge uniformly to the function f (x) in the interval (—zx, 1), 
then this series must be the Fourier series of this function. 


In this course we cannot consider other orthogonal systems of 
functions than the system (2). It is nevertheless interesting to note 
that all we have said above with regard to coefficients and Fourier 
series is based purely on the property of orthogonality of the system 
(2) and is quite independent of any special characteristics of the 
trigonometrical functions which form the system; for this reason 
everything we have said can refer to every orthogonal system. If the 
continuous functions . 


91(%), P2(x), a 8iti9 @ nlx), =e (8) 


form an orthogonal system in an interval (a, 6) and if the series 


a 


vB An P(X) = f (x), (9) 


n=1 
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where @,, are constant real numbers, is uniformly convergent in the 
interval (a, b), then, in the same way as above, we readily obtain : 


b 


[send =a, 2 (x) dx (n=1,2,...); 


a 


assuming, for the sake of simplicity, that*) 
b 
| Pin ahae acd Ge Ty yh 
a 


we therefore obtain: 


b 
Qn = [ro Q, (x) dx hee Ty 2) eee (10) 


The numbers a, which we have found for the function f (x) by means 
of the formula (10) are called the Fourier coefficients of this function 


and the series (9) its Fourier series (with respect to the orthogonal 
system (8). 


The general theory of orthogonal systems is one of the most 
important chapters in mathematical analysis and has numerous 
practical applications. At present many investigations are being 
made in this field. Much progress in this direction was made by our 
scientists Chebyshev and Liapunov and several other Soviet mathe- 
maticians (Bari, Kolgomorov, Luzin, Menshov, Steklov and others). 


For exercises to § 81 cf. Problem Book by B. P. Demidovich, 
Sectiou V, Nos. 332, 334, 341-344. 


§ 82. Average approximation 


Before proceeding to the solution of the fundamental problem 
of convergence of Fourier series we will now show that the Fourier 
coefficients of the given function possess great practical values 
regardless of the fact whether the series (3) § 81 is divergent or 
convergent. If this series converges at a point x, then the function 


*) The system (8) which satisfies this condition is called normalised ; evidently 
ev ery system (8) can be normalised by multiplying its constituent functions by some 
constant numbers ; thus in the system (2) it is sufficient to multiply the first term 
by 1/27 and the remaining terms by | / / 7, 
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f(x) can be represented approximately with any required degree of 
accuracy by its partial sum: 


n 
Sn (xX) = + y (a, cos kx + 6, sin kx), 
k=1 


which is a so-called ‘‘trigonometrical polynomial’. In general, a 
trigonometrical polynomial of degree n is a sum of the form 


Ty (x) = 2 - - (a; cos kx -+ f; sin kx), (1) 
k=1 


where «;, @; are constant real numbers. 


But we have seen in chapter 20 that regardless of the possibility 
of expanding a function into a power series there may arise the 
question of its approximate expression in terms of a polynomial. 
Similarly in this case, regardless of the possibility of expanding the 
function f(x) into a trigonometrical series, we can also consider its 
approximate expression by a trigonometrical polynomial of the 
type (1). 


If the order 2 of this trigonometrical polynomial is preassigned, 
then naturally the question arises how to select the coefficients «,, By 
of the polynomial T,, (x) so as to obtain the best approximation. If 
we are in this case considering the approximation of the function / (x) 
not at one particular point but in the whole interval (— zx, 7), then 
we must also define what is meant by a “best approximation”. The 
difference f (x) — T, (x) whose magnitude (i.e. absolute value) we 
naturally regard as a measure of the quality of the given approxi- 
mation, will have different values at different points of the interval 
(—n, 7). If we havetwo different trigonometrial polynomials T, (x), 
this difference will in general be smaller for the first of these poly- 
nomials at some points, while at other points it will be smaller 
for the second polynomial; we cannot directly see which of these 
two polynomials represents the function f(x) better. To obtain a 
unique evaluation for the comparative quality of approximations 
given by different polynomials we must evidently agree to assess 
this quality in each case by a definite number. This number canbe 
chosen by various methods in the same way as we can choose 
different thermometers for measuring temperatures; in this case, as 
in the above case, the advantage of this or other method of evaluation 
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does not depend so much on fundamental considerations but chiefly 
on convenience. 


In the same way as we have evaluated the closeness of two 
points by the distance between them, so in this case in ordcr to 
evaluate the closencss between the function / (x) and the trigono- 
metrical polynomial T,,(x) we mustclearly determine the ‘‘distance” 
between them; the smaller this distance is, thc closer the approxi- 
mation of the function f (x) given by the polynomial 7, (x). Natu- 
rally the determination of this distance must in one way or other 
take into consideration the magnitude of the difference f(x) — T,, (x) 
at every point in the interval (— x, 7). One convenient definition of 
this distance is given by the upper bound of the quantity 
| f(x) — Tp (x) | in the interval (— =, x). Another possible defini- 
tion can be provided by the ‘“‘mean value” of the saine quantity 


Jy | UF) = Ta) de (2) 


in the interval (— 7, =). However, it is more convenient (and it is, 
in fact, most frequently used in the theory of orthogonal systems) to 
use the definition of the distance between f (x) and T, (x) given by 
the mean value 


é 


= | Lf (x) — Tr (xP de = 0 (f, Tn) (3) 


of the square of the difference f (x) — Tn (x); this definition has a 
purely practical advantage over the definition (2): in calculations it 
is more convenient to deal with squares of functions than with their 
absolute values. 


In future we shall define the distance between the function / (x) 
and the trigonometrical polynomial by means of formula (3); we 
shall say that out of the two polynomials T,,,1 (x) and Tnye (x) the 
former gives a better approximation for the function f (x) than the 
latter if 


0 (f, T m1) a e(f, T me); ; 


the best approximation of all trigonometrical polynomials of order x 
is given by the polynomial T,, (x), for which. the distance e (f, Tp) is 
the least. 
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Having thus agreed on this definition we are faced with a com- 
pletely defined problem we must find the polynomial (1) of degree n, 
for which the quantity pe (f, Tn) has the least possible value. But 
finding of the polynomial T,, (x) implies finding of its coefficients. 
The quantity p (f, T,,) is evidently a function of these coefficients i.e. 
a function of 2n + 1 numbers a, @, ... 5 Gn. Br «> Br if the poly- 
nomial T,, (x) is given by formula (1). Heace we must find those 
2n-+ 1 numbers for which the quantity e(f, Tn) has its least 
possible value. 

For this purpose let us represent the expression (3) for the 
quantity e (f, T,,) in the form: 


a fre wack | T20 a= 2 fy Ta (3) df (4) 


Determining T (x) by means of formula (1) a denoting by ap, ba 
the Fourier coefficients of the function f(x) we obtain as a result of 
the formulae (5), (6), (7) § 81: 


[ re Uglsjde =r {on + y (50+ Babs) (5) 
T k= 1 
On the other hand, bearing in mind the formula 
Tw wv 
| cos? kx dx = | sin® keds =m (= 1,2) 0) 
—T —T 
and orthogonaity of the system (2) § 81 we obtain : 
Tr re : m n 
| Leeds = [i + » ay cost®kx + 6,2 sin? kx) dx = 
-—t —7 k=] 
P n 
a 
=n}5e + Sat + pit. (6) 
k=1 


Substituting the expressions (5) and (6) in the expression (4) for the 
quantity 2(f/, T ») we have: 





e(f,T») = fp 2 (x) de + jue See, 


n 


+ Lilest-2ar09) + (Bx? 26 82) 5 
k=1 
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noting that 
9 
aE” — 2a, = (a, — ax)* a ae, 


B ,,” aa Te ee (Bx — by)? a by 


we consequently obtain : 


FT) = a ffs) dx — 4S + , (at + be) f+ 
ae k=1 





1 ({a9 — ay)? : 
$7 fest Pier — aa + Bs 6,)"f. 
k=1 


The first two terms on the right-hand side of this equation are 
independent of the coefficients a,, 8, of the polynomial T ,, (x) ; there- 
fore the numbers «;, &;, must be so chosen that the third term should 
have the least possible value, i.e. the quantity 








ean + Vea (By ons 


this quantity evidently vanishes if we choose 
te = ay (k= Oy 15025 
By = db, (k= 1, Zs ma) 


and becomes positive for every choice of the numbers «,, 6x. This 
solves our problem. We see that in order to obtain the best 
approximation for every n we must choose the corresponding Fourier 
coefficients of the function /(x) for the coefficients of the polynomial 
T ,(x). In doing so we must naturally bear in mind that this deduc- 
tion will only be valid if we are evaluating the distance between the 
function f(x) and the polynomial 7 (x) by means of the quantity 
(3). Ifwe use a different method for determining the distance, we 
obtain different values for the numbers «7, B x. 


Approximations in which the distance between two functions 
is evaluated in terms of the average value of the square of their 
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difference are usually called average approximations. ‘The result 
obtained above can therefore be formulated as follows : 


Theorem 1.° From all trigonometrical polynomials of degree n the best 


average approximation is given by the following polynomial, provided the 
Junction f(x) is continuous : 


Tix) = = + y (a,coskx + 6, sin kx), 
- Se k=] 


where a; by are Fourier coefficients of the function f (x). Also 


v 


of Ta) = a Sladd -2(F + +E ae + 5,2) . (7) 


3 


The equation (7) gives one interesting result. " Since 


eras 


therefore for every n 


oe + Lev +b) < ifr (2) da 


the right-hand side of this equation is independent of 7; therefore 
the partial sums of the series 


o 


‘f+ Yoo ton 


remain bounded for n + ©; and since this series has constant signs, 
it must be convergent. Hence the squares of the Fourier coefficients of a 
continuous function always form a convergent series. It also follows that 
when n > oo, we always have for a continuous function : 


aQn—2>0, b,-> 0. 


§ 83. Dirichlet- -Liapunov theorem on closed trigonometrical 
; systems 


We have learnt in the _ theory of power series that the same 
Maclaurin series can be’ used for an infinite number of different 
functions. A simpler question naturally arises, and is equally 


TRIGONOMETRICAL SERIES * ea 389 


important, with regard to Fourier series ; can the same trigonometrical 
series be the Fourier series of several .different functions ? ;We must 
at first draw attention to the fact that in solving this problem it is 
advisable to consider continuous functions only, for otherwise the 
resulting solution would be trivial; in fact, if.we are to consider 
discontinuous functions, then we shall change the. value of the given 
function f(x) at a particular point; it can be readily shown that the 
new ee will have the same Fourier, coefficients as the function 
f(x), since the integrals in the formulae (5), ( (6), (7) § 81 do not change 
in magnitude as a result of this change in. the function f(x) 


The above problem, as we shall now see, is closely related to an 
important property of the orthogonal system 


we (1) 
of trigonometrical functions. Let us assume that there exist two 
different functions f;(x) and f2(x) which are continuous in the 
interval ( —- x, ~) and have the same Fourier series, or, what is the 


same thing, the same series of Fourier coefficients. Let us now 
consider the function 


1, cos x, sin x, cos 2x, sin 2x, 


I(x) = fale) — fa (x) 


it follows from the formulae (5), (6), (7) §,81 that any Fourier coeffi- 
cient of the function f(x) is equal to the difference between the 
corresponding coefficients of the functions f(x) and f(x) and is 
therefore equal to zero. We thus have : 


fro cos kxdx = 0, 


7 


ve 


[so sin kxdx = 0 ; 
—-—-T J { 


But this implies that the function f(x) is orthogonal to any one of the 
funtions of the system (1) in the interval ( — x, 2). Thererefore, if 
there exist two different functions which are continuous in the interval ( — x, 7) 
and have the same Fourier sertes, then there exists another function which is 
also continuous in the interval ( — mn, ™) but does not become zdentically zero ; 
this function is orthogonal to all functions of the system (1) in that interval. 


1 
| 
| 
\ 
| 
| 


It can be readily seen that the converse proposition also holds. 
In fact, if the function f(x) is continuous and does not become 
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identically zero and is also orthogona! to all functions of the system 
(1) in the interval ( — x, =) and if 9(*) is an arbitrary function 
which is continuous in that interval, then the function ?{x) + f(x) 
will also be continuous in the interval ( — x, 7); it does not coincide 
with ¢ (x) whereas all its Fourier coefficients coincide with the corres- 
ponding coefficients of the function ? (x). 


The question therefore arises, whether it is permissible to “add” 
to the orthogonal system (1) another continuous function which is 
not identically zero so that the extended system should remain 
orthogonal. For this extension of the system (1), as we have just seen, 
it is necessary and sufficient that the two different functions which 
have the same Fourier series should exist. An orthogonal system 
which can be extended in this way is called an open system; a closed 
system, on the other hand, does not permit such an extension. We 
must therefore decide whether the orthogonal system (1) is closed 
or open. 


The most important property of the closed system follows from 
the remarkable investigations by Dirichlet on convergence of trigono- 
metrical series; the same facts were, however, earlier established and 
proved independently somewhat later by the outstanding Russian 
scientist Academician A. M. Liapunov. Therefore we shall in future 
call this theorem the Dirichtet-Liapunov theorem. 


Dirichlet-Liapunoy theorem. The orthogonal system (1) ts closed. 


Proof. Let the function f{*) be continuous in the interval 
(—x, x) and orthogonal to all functions of the system (1) in that 
interval. We must prove that f(x) = 0(— xz <x <n). 


It evidently follows from orthogonality ofthe function f (x) and 
any other function of the system (1) that it is also orthogonal to an 
arbitrary trigonometrical polonemial T (x). We shall prove converse 
of this theorem ; let us assume that the function f(x) is not identi- 
cally zero in the interval (— x, =), and on the basis of these consi- 
derations we shall construct a trigonometrical polynomial to which 
the given function cannot be orthogonal in the interval (— x, x). 


Let, for example, f (x) > Oforx =«,—2x<a< 7. In that 
case we have f(x) > 0 for a sufficiently small 8 > O and for all points 
x in the interval (« ~— 5, a + 6); let¢ > 0 be the smallest value of 
iLe function f (x) in that interval so that 


fi) 2ece>O0 @-—-8SKx<u«4+ 8). 
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Let us now assume that 
Poe jroo —s) } sf 


where n is an arbitrary natural number. Raising the power in accor- 
dance with the binomial formula we evidently obtain: 


Tn (x) = ys cy [cos (x — a)’, 
r=0 


where ¢, are constant real numbers. It is known that for every r > 0 


the function (cos x)” can be represented as a linear combination of 
functions 


1, cos x, cos 2x, ... , COs 7x 


with constant coefficients.*) Applying this expansion to all terms ot 


the above sum we obtain: 


n 
Tee = ,, d,cos r (x — &), 
r=0 
where d, are constants. Finally, since for every 7 


cos r (x — «) = cos ra cos 7x + sin ra sin rx, 


we obtain the following expression for T,, (x): 
n 
Tan) = 2 aig y (a, cos kx + &, sin kx), 
k=1 


*) Proof, This statement is obvious forr =1. If 
r 


(cos x)” = y a, COS 5x, 


s=0 
then 


r 
(cos x)7™+1 = (cos x)” cos x = 7, a, COS sx CO A = 
s=0 
r r+ 
1 ee 
= TY) ag Leos (s + 1) x + 00s (s—1) s] = P, COS ox. 
s=0 s=0 


392 A COURSE OF MATHEMATICAL ANALYSIS 


where ¢,, 8; are constants. This shows that for every, naturaln the 
function 7, (x) is a trigonometrical polynomial. We will now show 
that provided 7 is sufficiently large, this polynomial cannot be ortho- 
gonal to the function f(x) in the interval (— 1, =). 


Let us imagine the main outlines of the course of the function 
T,, (x) in the interval (— x, x) when 7 is large; this will also enable 
us to perceive clearly the true meaning which lies at the basis of the 
foliowing proof. The quantity 


1 + cos (x — a) 

a ee 
whose n-th degree is the polynomial T,, (x), is evidently always non- 
negative; it is equal to umity for += « and less than unity 
for all other values of x in the interval (— x, 7). Therefore when n 
is large, T, (x), which is always non-negative, is equal to unity for 
x = « and negligibly small for all other values of x which are only 
a small distance away from a, so that the course of the function 
approximately follows the graph shown in Fig. 51. We must prove 


that the integral 
mn 


| f (x) Tn (2) dex 2) 


—T 


cannot be equal to zero when n is sufficiently large. For this pur- 
pose we can break the integral (2) into two parts: 


“+s 
| FOOT te at 
a—§ 
and 
a—§ ™ 
[ | + | Jronwens 
—k ats 


Since the second of these integrals includes the region in which 
T» (x) is negligibly small, we have reason to believe that the abso- 
lute value of the integral is also 
negligibly small. On the other 
hand, we know about the first in- 
tegral that f (x) > c¢ > Oinit and 
the function 7, (x) attains its maxi- 
mum value. We therefore have 
good reasons to expect that the 
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absolute value of the first integral will be considerably greater than 
the second integral; but this is all that is needed since if J; > J,, we 
cannot have J; + J, = 0. 


Let us now perform the necessary calculations. Owing to the 
fact that 


J + cos (x — a) 


7 = cos? (45°), 








we have 
ats a+ 
= [ro cos a a *) dx > ec | cos?” (“5S ex. 
a—§ a—s§ 


Assuming that x = « + y we obtain: 
é 5 
on . BNE 
Le ¢ | cos (4) dy = 2¢ | (2 — sin? 2 ) dy. 
= § 0 
Since 0 < sin y/2 < 1 and 0 < cos »/2 < | in the interval (0, 5), 
therefore ‘ 


(1 - int) > (1 — sin 2)" cos s, 


and we obtain: 
8 . : 
: ? 
I, > 2e | (1 -— sin 4) cos aD 
0 


or, assuming that sin y/2 = z, 


sind 
de . 6 \tt 2¢ 
0 


so that the expression inside the braces is evidently greater than 1/2 
when n‘is sufficiently large. 


We have evaluated the lower limit of the integral J;; we shall 
now try to evaluate the upper limit of the absolute value of the inte- 


gral Iz, Let us denote by Ad the maximum value of the function 
g 
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| f (x) | in the interval (— x, x). Within limits of the two integrals 
which form the integral J, i.e. when |x — «| > 5), we have: 


cos? G 5 * < cos? ($) 





and therefore 


| ZT, (x) | < cos m(2); 


hence 


| I,| < Meos**(>-) [(@ — 8) — (—a) +#— (2+ 8) < 


< 22M éos2" (}) = 26 Air’, (4) 


where it is assumed ‘that 


f= cos* (=) <1, 


Owing to the fact that for a sufficiently large n we have *) 
‘ De 
2n Mr? < ae 
and it follows from (3) and (4) that | Z,| < J, provided 1 is suffici- 
ciently large. ‘The equation 
qT 


[/@ Te) de = + = 0 


_—kT 


cannot therefore hold and the Dirichlet-Liapunov theorem is proved. 


We can thus see in the light of the problem considered above 
that the behaviour of Fourier series differs from that of Maclaurin 


series : every trigonometrical series can be Fourier series of only one 
continuous function. 


§ 84. Convergence of Fourier series 


We shall now consider the fundamental problem, riz. the 
properties which the function f(x) must possess in order tliat its 
Fourier series should be convergent and its sum be equal tothe given 





*) This follows from the relation nr™—~0(n-— ©) (cf. proof of theorem 4 


$77). 
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function. This problem is, on the whole, very complicated and 
modern science has not yet succeeded in solving it fully. On the one 
hand, we know many tests which enable us to determine expansion 
of this or other class of functions into Fourier series; however, it has 
been shown by many examples that relatively simple functions -have 
divergent Fourier series. In this paragraph we shall only prove one 
proposition which shows how wider is the class of functions which 
can be expanded into Fourier series Ale the class of functions which 
can be expanded into power series: ae 


Theorem. The function fle) \ with a period 2n, whose first derivative 
is continuous everywhere, can be feet into a uniformly convergent trigono- 
metrical series along the number line {it follows from the basic result of 
§ 81 that this series is its Fourier series). 


Proof. Let us denote by a,, 5, the Fourier coefficients of the 
function f(x) and by a’,, 6’, the Fourier coefficients of the function 


Si (x). The formulae (5), (6) § 81 and integration by parts for k > 0 
give : 


Ta = fy S (x) cos kx dv= 


vv 


_ f f(x) sin kx \ FF ‘ Oe 
(Ase _) — bt: J’ (x) sin kx dx = _ 3 
—nk 
Tb, = [re sin kxdx = 
Be wT 
| £08 kx ier nay 
= (-fee ee al (x) cos kx dx = Tg 
Wi eat 
We therefore have : 
b’ a’ 
4=——, La (k = 1, 2, ...). (1) 


Since for any two numbers @ and f it follows from 
2 +f —2/aB]=(la]—1 Bi) >0 
that rns : 
2 op) bee? SG, 
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therefore the relation (1) gives : 


i} 


Fa 2) bel < ae? + ae 


2ia|< oe Re? 


and hence for every x 


: MS seve geet ; 1 
| a, cos kx + by sin kx | <lax| + [be] <> (@e? + Oo") + Pog (2) 
Since the numbers a’,, 6’, are Fourier coefficients of the conti- 
nuous function f’ (x), it follows from the final result of § 82 that the 


series . 


, (a's? + 042) 


f= 1 
fee} 
: ‘a3 . 1. 
is convergent; and owing to the fact that the series y Fa is also con- 
k=1 


vergent, the right-hand side of the inequality (2) represents the k-th 
term of a convergent numerical series with positive terms; but it also 
follows from (2) that the series 


4 es y) (ax.cos kx + b, sin kx) (3) 
k= 

is absolutely and uniformly convergent along the whole number line. 
Let us denote its sum by s(x) ; it follows from the fundamental result 
of § 81 that the series (3) is the Fourier series of the function s (x) 
whereas, by definition, it is the Fourier series of the function /(+). 
Since both functions f(x) and s(x) are continuous, therefore, it follows 
from § 83 that they must coincide; this proves our theorem. 


§ 85. Generalised trigonometrical series 


We have already'mentioned in § 81 a self-evident fact that 
functions with a period 27 can only be expanded into trigonometrical 
series along the whole number line. ‘A function f(x) which does not 
possess this property, may, at: best, be expanded only in (arbitrary) 
interval (a, a + 2x) of length 2x ; it is then evidently also necessary 
that f(a 4+ 27) = f(a). This restriction, if it could not readily be 
removed, would greatly reduce the use of ‘trigonometrical series. In 
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this paragraph we shall briefly consider how it is possible to enlarge 
the concept of trigonometrical series simply and naturally be remov- 
ing this obstacle. For the sake of simplicity we shall always assume 
that the given function f(x) has a continuous derivative at every 
point in the given interval (a, 6) in which we wish to expand it into 
a trigonometrical series. 


If we are considering an interval (a, a + A) which is shorter 
than 2x (A < 2x), then our problem is evidently very simple; all we 
have to do is to continue the function f(x) in the interval (2 + A, 
a + 27) in an arbitrary manner and we have f(a + 2) = f(a) and 
Sf’ (a + 2n) = f'(a); the function f/(x) would then have a continuous 
derivative in the whole interval (a, @ + 2n) (this’can, of course, be 
done in an infinite number of ways). It follows from $-84 that the 
continued function can be represented in the interval (a, a + 27) 
by a uniformly convergent series whose sum evidently coincides with 
the given function f(x) in the interval (a, @ + A);-this solves our 
problem. It is also interesting'to note in this connection that when 
A < 2x, continuation of the function f(x) along the whole interval 
(a, a + 2x), which can be done in an infinite number of ways, will 
also give an infinite number of different Fourier series for the initial 
function. The sums of these Fourier series will obviously be different 
functions if we consider them in the whole interval (a, a@ + 7), 
However, they will all coincide with the function f(x) in the interval 
(2,2 + A). Thus the function can in general be represented by an 
infinite number of different trigonometrical series in an interval of 
length < 27. 


Let us now assume that A > 27x; we again assume that the 
function f{(*) has a continuous tne in the interval (a, @ + A) 
and f(a + A) = f(a), f’(a + A) =f" (a); we can then assume that 
the function f(x) is periodically eae across the ends of ‘the 
interval (a, a + A) (with a period A) along the whole number line. 


Let us assume that 


=at sy, f (x) =f(at gy) =? 0 

The function ¢ (y) is evidently a periodic function with a period 2x 
(since on increasing y by 2x we evidently increase x by A) and it has 
a continuous derivative for ev ery V3 denoting by a, and 6, the Fouricr 
coefficients of this function we obtain for every ), as a result of the 


theorem in § 84, 
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9(9) = “2 +P (ax cos ky + by sin ky), 
k=1_ 
where the series is uniformly convergent along the whole number 
line. Since 
‘1 On “ 
| Jz (* - 9), 


therefore we have uniformly along the whole number line 
f(s) = = Si : [ axcos =F (x ~ a) + by sin ee: (4) (1) 
=i 


applying to the expressions : 


2nk 
A 


cos 





(x — a), sin = (x — a) 


the trigonometrical formulae for the cosine and sine of difference of 
two arguments we evidently obtain the expansion (1) in the form 


Fa 3+y (ax gos ark x +6; sin ott), 


k=] 


where «,, 8, are constants; in particular, when a < x < a + A, the 
sum of this series coincides with the corresponding values of the 
function f(x) given in that interval. 


We can thus see that the function f(x) defined in an arbitrary 
interval (a,a-+ A) can be expanded into a generalised uniformly 
convergent trigonometrical series in that interval (provided the above 
conditions are satisfied) which differs from the series 1 § 81] only in 
that instead of the functions of the system (2) § 81 we have, in this 
case, the following elements of expansion 

1, cos x, sin 7a (n = J, 2, ...), 
which, as can be readily shown, form an orthogonal system in the 
interval (a, a2 + A) (and in every interval of length A). All functions 
of this system have a period 4. As before, we find the following 
expressions for the coefficients «;, 6; 
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at+iz 
op =2 J f(x) cos x dx (60,1, 2 2.0), 
a+i 
9 
== | so ) sin 7 x dx Ca Oa ares 
a 


Finally, if the conditions f(a + A) = f(a), f’ (a + A) =f" (a) 
which are necessary for this expansion are not satisfied, we can 
always continue the function f(x) beyond the point a + A toa certain 
point 6 >a-+tdA so that all the requirements are satisfied in the 
interval (a, 6) and we can then expand the function /(*) in the 
extended interval in the way described above. 


For exercises to § 85 cf. Problem Book by B.P. Demidovich, 
Nos. 331, 356, 357. 


CHAPTER XXII 


DIFFERENTIATION OF FUNCTIONS OF 
SEVERAL VARIABLES 


§ 86. Continuity of functions of several 
independent variables 


When we first introduced the concept of functional dependence 
(chapter 1), we regarded the function y = f(x) of one independent 
variable x as the simplest form of this general concept. The types of 
functional dependence which we meet in practice usually involve 
quantities which depend not on one but several (sometimes very 
many) other quantities whose values can be chosen arbitrarily and 
independent of one ancther so that we can call them independent 
variables. Only when these values are selected in a definite way, 
the function acquires a definite value. However, we have so far 
only studied the simplest case, vz. of one independent variable. In 
fact, the methods of differential and integral calculus can be success- 
fully used for functions of any number of independent variables. 


In this chapter we will, as a rule, consider in detail only the 
extension of methods and concepts of differential and integral cal- 
culus to functions of two independent variables and we shall leave 
the reader to prove for himself that increase in the number of vari- 
ables does not involve any other new ideas. As we shall sec, this 
method is useful insofar as the transition from functions of one 
independent variable to functions of two variables introduces some 
entirely new points and, in order to study them fully, we shall have 
to concentrate on this problem without dissipating our attention on 
a too bulky formal apparatus. On the other hand, the transition 
from two to three or more independent variables involves, as a rule, 
only some technical difficulties which can readily be overcome after 
the theoretical part has been fully understood. 
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Let u be a function of two independent variables x and y. In 
the same way as we have so far represented different values of the 
variable x by points on a straight line (‘number line’’) and called 
these values “points” in some cases, we shall from now on often 
regard the independent variables x and »y as the rectilinear coordinates 
of the point in a plane which we shall call the “number plane” ; now, 
instead of speaking about ‘“‘a pair of values (x, y) of the independent 
variables’? we shall simply speak of the “point (x, _y)’’ and the value 
of u for x = a, y = 6 as its value at the “point (a, 6)’. This termi- 
nology is very convenient in two respects : firstly it is in most cases 
much shorter (while giving the same degree of accuracy) and, 
secondly, it naturally tends to give a visual representation which in 
many cases makes it easier to understand the problem in question. 
In some cases it is convenient to denote the point (x, y) by a single 
letter, for example P, Q,... and write in short u = f(P) instead’ of 
u= f(x,y); this method is not often used in dealing with two inde- 
pendent variables since this abbreviated notation is not very useful; 
however, when we have severa! independent variables, this abbrevi- 
ation can be very useful. 


In the same way as the function » = /(x) is represented geome- 
trically in the rectilinear system of coordinates (x, y) by a curve which 
is only intersected at a single point by an arbitrary straight line 
parallel to the OY-axis, so the function u = f(*, y) can be repre- 
sented in the rectilinear system of coordinates (x, y, u) by a surface 
which is only intersected at a single point by an arbitrary straight 
line parallel] to the OU-axis (this is equivalent to the condition that 
not more than one value of w should correspond to each pair of 
values of the variables x, y). We know the significance of graphical 
representations in the study of functions of one variable x. The 
geometrical illustration of functions of two variables by means 
of a surface in the three-dimensional space is equally important in 
the study of their theory. 


Let the function u = /(x,.y) be defined in region * of the plane 
and let P(a, 6) be a point in this plane. Apart from this point, let 
us consider another point P’ (x,y) which we shall imagine to move 





*) At present the form of this region is irrelevant: it may be a square, a 
circle or any other finite figure, or the infinite part of the “number surface”’ or the 


whole of this surface. 
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indefinitely close to P so that x > a and y +); this can be expressed 
by the relation, 





p= Vea? +O — oP +0. 


If in this process the quantity f(x,y) tends toa definite limit A, we 
can write 


f(x, 9) > A (Pp +0) or es f(x, 9) = A. 
o> 


It is very easy to describe the process by means of the relation 
p — 0; however, we must note that in this case we are dealing with 
the limiting process in its most general form as considered in detail 
in § 15; in fact, f(x, y) is not a function of the ‘“‘basic variable” 
e, for evidently at a given distance ep from P an infinite number of 
points P’(x, y) lie where the function f(x,y) will in general have 
different values. Nevertheless, the above relation has a quite definite 
meaning : no matter how small ¢ > 0 be, there exists a 8 > 0 such 
that for any point P’ (x,y), other than P, which is at a distance not 
less than 8 (i.e. the only condition is that ep < §} we have: 


| f(* 9) —Al <e. 


Having thus defined the concept of limit for a function of two 
variables it is obvious to define the concept of continuity for such 
functions which we have found to be of fundamental importance in 
the case of functions of one variable. 


The function u = f(x, y) is said to be continuous at the point (x, y) tf, 
assuming thatp = V Ax°+ A y*, we have: 


lim f(x + Ax,» + Ay) = f(% 2). 
e—>0 


In detail this implies as follows : there exists a 5 > 0 for any 
e > 0 such that, provided p < 8, we have: 


| Aul =|f(e+ Axy+ Av) —S(y a) 1 <e. 


We can see that as before, the concept of continuity is of local 
character : in general the function of two variables can be continuous 
at some points and discontinuous at others. And again, as before, 
we shall agree to call the function f(x, y) continuous within the given 
region of the number plane if it is continuous at every point in this 
plane. 
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While studying the functions of one independent variable we 
have considered in detail the structure of the continuum (the set of 
real numbers), i.e. the set of values of the independent variable itself, 
before studying the main properties of continuous functions (chapter 5). 
Similarly in this case too we must begin with the detailed study of 
the properties of sets of pairs (x,y) of real numbers before studying the 
properties of functions of two variables. This set is usually called the 
two-dimensional continuum ; geometrically it is represented by a plane. 


We haveso far spoken of functions oftwo independent variables ; 
however, all that issaidin this paragraph also holds for functions of any 
number of variables so that we only need to give brief introduction. 


If wu is a function of n independent variables, it is convenient to 
call the set of values of these functions a point in an n-dimensional space 
(or a space of n dimensions). ‘The distance between two points is equal 
to the square root of the sum of the squares of differences of the 
corresponding coordinates at these points ‘for n = 3 we have the usual 
distance between two points in the three-dimensional space). ‘The 
function wu == f(x, y, z) is continuous at the point (x,y, z) ot the three- 
-dimensional space if 


Au = f(x BA AIS Az) — f(x, 9; z) >0 (p — 0), 


where 





p= Var pay tad 


(there is no need to give the definition of continuity for n > 3, as it is 
-self-evident). In order to study the further development of the science 
-of functions of n variables it is necessary to consider in detail the pro- 
perties of an x-dimensional continuum, ie. the set of all groups of n 
real numbers (a, de, «++, Gn): 


The student is advised to consider the instructive examples in 


the Problem Book by B.P. Demidovich, Section VI, Nos. 44, 45, 55. 


§ 87. Two-dimensional continuum 


On a straight line we can have only one type of simple figure, 
viz. an interval. However, in the transition to a two-dimensional 
-continuum, viz. the plane, we can havea great variety ofsimple figures : 
-polygons, circles and, in general, other figures bounded by simple 
contours. The variety of these figures introduces many new points 
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in the study of a two-dimensional continuum as compared with the 
simplest linear (one-dimensional) continuum. 


The set of all points of this simple figure is called the regzon which 
is closed if all points on the contour belong to the region and open if 
no point on the contour belongs to the region. For the time being, 
we shall disregard regions extending to infinity : thus, for example, 
we shall call a region (closed) semi-plane « > 0 or the whole number 
plane in the same way as we have earlier regarded the semi-straight 
line x > 0 or even the whole number line as being particular cases 
of intervals. 

If the point P (x, y) is an interior point (7.e. it does not lie on 
the contour) of the region D, then any sufficiently small circle with. 
centre at P together with all its points will belong to the whole region. 
On the other hand, if P is a point on the contour (or, as it is usually 
said, on the boundary) of the region D, then any circle with centre at 
P will contain points which belong to the region D as well as other points 
which do not belong to it. These properties can be regarded as 
definitions of interior and boundary points of the region. An open 
region consists solely of interior points ; a closed region contains, apart 
from interior points, all boundary points too. , 


In the case of the linear continuum the dimension of simplest 
figures are fully described by theirlengths. In the case of planes the 
pesition is somewhat more complicated : in relation to the problem 
in consideration we may be interested in the area of the given region 
or in its linear dimensions; the latter are best described by the diameter 
of the region which is defined as the upper Lound of the common distances 
between all possible pairs of points belonging to the given region ; thus the 
diameter of a circle is the length of its usual diameter, the diameter 
of a rectangle is the length ofits diagonal, and so on. If the upper 
bound, which we have mentioned above, exists, the region is said to 
be bounded ; otherwise it is infinite ; an infinite region is sometimes 
said to havea diameter equal to -++ 00. In order that a region should 
be bounded it is evidently necessary and sufficient that it should lie 
entirely within a circle (in the same way as a linear set is bounded 
if and only if it lies entirely within an interval). 


Let us assume that we are given a region D and a point P in 
a plane and let p (P, Q) denote the distance between two points P 
and Q in the plane. If Q runs through different points of the region 
D, then p (P, Q) has a definite lower bound which we shall call the 
distance of the point P from the region D and denote by e(P, D). 
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Theorem 1. Jf the point P does not belong to the closed region D, then 
9(P, D)> 0. 


Proof. Where ¢{P, D) = 0, then any arbitrarily small circle 
with centre at P would contain points of the region D. In that case 
there are two possibilities : 

(1) any sufficiently small circle with centre at P belongs entirely 
to the region JD, or 


(2) any circle with centre at P contains points of the region D 
and other points which do not belong to that region. 


In the first case the point P would, according to the definition, 
be an interior point and in the second case it would be a boundary 
point of the region D. Since theregion D is closed, the point P would 
in either case belong to that region, which contradicts the conditions 
of the theorem. Hence e(P, D) > 0 and thcorem 1 is proved. 


Analogous to the theorem on a contracting sequence of sections 
{§ 18, lemma 1) we must now establish the corresponding important 
theorem on contracting sequences of closed regions. The sequence 
of regions D,, Dz, ..., Dy, .-. with corresponding diameters dj, d., ..., 
dn, ... is said to be contracting if 1) Daz, = Dn(n = 1, 2, ...) (Ze. 
theregion D,,+, lies entirely within the region Dy, and 2)d,—> 9 
(n —> 00). 


Theorem 2. The contracting sequence of closed regions always has one 
common point for all regions of the given sequence. 


Proof. Let us denote by (a,, b,) the intcrval which is projec- 
tion of the region D, on the OX-axis and by (¢n, d,) a similar interval 
on the OY-axis. Evidently each of the two sequences (dn, bn) 
(n = 1,2, ...) and (¢n,¢dn)(n = 1, 2, ...) represents a contracting 
sequence of intervals. Let « be the common point for all intervals 
(ans bn) (it follows from lemma | § 18 that such a point exists and is 
unique) and let 8 be the common point forall intervals (cn, d,,). We say 
that point P («, 8) belongs to each of the regions D,. In fact, if a 
closed region D, exists which does not contain the point P, then, 
according to theorem !, we would have e(?, D;) =d>0, But 
D,— D;,) for 1 > k, and therefore 


e(P,D:) >e(P, Diy) =a (1D). (1) 


But if Q (x, y) is an arbitrary point of the region Dj, then x and « belong 
to the interval (a,, 61) and 8 and y to the interval {c¢;, d;) so that 


e(P, Q) = V (x — a+ (iy — B)? < V(b, — ay)? + (d;— ci)", 
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and therefore 





o(P, Di) < V(bi — 01)? + (di — 61)? (2y 


but b; — a; > 0 and d; — cc; > O for 1 > o and therefore, accord- 
ing to (2), e(P, D: — 0, which contradicts the inequality (1) 
according to which e(P, D;) > d for every! 2 k. Hence the point 
P («, 8) belongs to each region D,. If another point P’, possessing 
the same property, exists, then let us assume that the distance bet- 
ween the points P and P’ is equal to p; in this case each of the 
regions D , evidently contains both points P and P’ and its diameter 
should not be less than p. But this contradicts the condition that the 
region D,, forms a contracting sequence. This proves uniqueness of 
the point P. 


We shall now prove the “‘theorem on finite coverage” which is 
analogous to lemma 2 §18. Let us assume that we are given (a 
finite or infinite} set (system) S of regions (D). We shall say that the 
system § covers a certain region A if each point of the region A is an 
interior point of at least one of the regions D of the system S. 


Theorem 3. If the system S covers the bounded closed region A, then 
another system can be separated from this system, which consists of a finite 
number of regions and which also covers the region A. 


Proof. Since the region A is bounded, it lies entirely within. 
asquare Q. Let us divide this square into four equal squares by 
drawing straight lines through the middle points of its opposite sides. 
We shall say that a square is “normal” if the part of the region A 
which it contains does not permit finite coverage required by theorem. 
3 (the square which contains no points of the region A is not regarded 
normal). Theorem 3 evidently implies that the square Q is not 
normal. On the contrary let us assume that it is normal; it can then 
readily be seen that out of the four squares into which it has been 
divided at least one square must be normal; in fact, if each of these: 
squares would permit finite coverage (or if it would contain no points. 
of the region A), then, evidently, the square Q as a whole would also. 
permit finite coverage. 


Let Q, be a normal quarter; dividing it again into four squares 
we see that at least one of these four squares inust be normal and so. 
on. We can continue this process as long as we please and as a 
result obtain a contracting sequence of squares Q, Q), Qe.... Let P 
be,the common point of these squares (according to theorem 2 this. 
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point exists and is unique). Let us at first show that P belongs to the 
region A. In fact, any circle with centre at P evidently contains 
all the squares Q, provided n is sufficiently large and therefore it also 
contains points of the region A. If, when the radius is sufficiently 
small, this circle entirely lies within the region A, the point P is an 
interior point of this region; if however, when the radius is as small as 
we please, this circle contains both the points belonging to A and the 
point not belonging to this region, the point P lies on the boundary 
of the region A; and since the region A is closed, the point P belongs 
to this region in either case. 


It therefore follows from the theorem that a region D of the 
system S exists where P is an interior point. Any sufficiently small 
circle with centre at P therefore entirely belongs to the region D; but 
such a circle contains, as we know, an infinite number of squares Q», 
each of which is thus covered by one region D of the system S$ 
whereas, according to its definition, it is normal and cannot permit 
finite coverage. This contradiction shows that our assumption can- 
not be correct, i.e, the square Q cannot be normal and therefore it 
should permit finite coverage. Theorem 3 is thus proved. 


Let us now assume that D, and Dy, are two bounded closed 
regions which have no points in common and let P be an arbitrary 
point of the region D,. According to theorem | there exists a circle 
with centre at P which contains no points of the region Dg, Let 
r(P) be the radius of this circle. Let us agree to call a circle of 
radius 47(P) with centre at P as ‘‘proper”’ circle of the point P, and 
let us denote by S the set of “‘proper”’ circles of all points P of the 
region D,. Since the system S covers the region Dy, therefore, 
according to theorem 3, there exists a finite group S$” of circles of the 
group 5, which also covers the region D,; let us denote by 6 the 
radius of the smallest circle of this finite group S”. 


Let P, and P, be two arbitrary points which belong to the 
regions D, and D, respectively. The piont P, lies inside a circle 
belonging to the group S’; let P and {r = }7(P) denote respectively 
the centre and radius of this circle. We then have firstly pe (P, P») 
> r (P) (since the point P, belongs to the region D,) and secondly 
o(P, P;) <1r=4r(P). Therefore 


“eo ( Pas. Ps) BoolPy fs) — p(P, Py) > r(P)—$r(P) =$r(P) > 8. 


And since P, is an arbitrary point of the region D,; and Py, an 
arbitrary point of the region D, therefore we can conclude that the 
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lower bound of all the distances o(P,, P,) is a positive number. This 
lower bound is called the common distance between the regions Dy and D,» 
and denoted by e(D,, D,). We thus arrive at the following impor- 
tant proposition. 


Theorem 4. Jf D, and D, are bounded closed regions with no points 
in common, then p(D,, D2) > 0. 


All the concepts, statements and proofs of theorems given in 
this paragraph can be extended to a continuum of arbitrary dimen- 
sions without making any essential changes, as the reader can readily 
show himself. 


§ 88. Properties of continuous functions 


We now possess sufficient knowledge in order to establish the 
main properties of continuous functions of several variables. 


We at first note that all theorems which we have proved in 
§§ 21 and 22 for functions of one variable also hold for functions of 
two variables. As a result of rational operations with functions 
continuous at an arbitrary point P we again obtain a function conti- 
nuous at that point (in the case of division it is only necessary that 
diviser should not vanish at the point P). The theorem on continuity 
ofa composite function should, in this case, be understood in the 
following sense: if 2 = f(u, v), u = 9, (%, 7), v = G2 (x,y) and if 
the functions 9; and 92 are continuous at the point P(x, y) in the 
XY-plane whereas the function f(u, v) is continuous at the points 
u= 0, (x, 9), v = Pe (x, 9) of the UV-plane, then the function 


F(x, 9) = f [91 (x,y), Pe (x, 9], 


which, as given in the above form, is called a composite function of 
x and y, is continuous at the point P. 


All these theorems are proved in exactly the same way as the 
analogous theorems in § 21] and § 22 and we therefore leave the proof 
to the reader. 


We shall now enumerate several more important properties of 
functions of two variables. 


Theorem 1. The function f(x, y) continuous in the closed bounded 
region D is bounded in that region. 
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The proof of this theorem is so similar to the proof of the 
analogous theorem | § 23 that the reader will have no difficulties in 
proving it by himself. 


Theorem 2. The function f(x, y) continuous in the bounded region D 
takes its maximum and minimum values in that region. 


We can again leave the proof to the reader, for it is analogous 
to the proof of the corresponding theorem 2 § 23. 


The concept of uniform continuity for functions of two variables 
is in all respects similar to that of functions of one variable and it is 
equally important. The function {(x, y) is said to be uniformly conti- 
nuous in the region D if the following condition holds: no matter 
how small ¢ > 0 be, there exists a 8 > 0 such that for any two points 
P, and P, of the region D which are at a distance 


e(P,, Po) <5 
we have: 


[f(P1) — f(P2) | <=. 


The following theorem which is similar to theorem 5 § 23 also 


holds: 


Theorem 3. The function f(x, y) continuous ai every point of the 
bounded closed region D°is uniformly continuous in that region. 


Although the proof of this theorem is quite similar to that of 
theorem 5 § 23 we shall nevertheless give it here in full since it is 
rather complicated. 


Proof. Let P be an arbitrary point of the region D and « an 
arbitrary positive number. Since the function f(x, y) is continuous 
at the point P, therefore at any point P’ of a circle with centre at P 
and a sufficiently small radius e(P) we have : 

€ 


| f(P’) ~L(P) | <3 


therefore if P’ and P’’ are two arbitrary points of the above circle 
(bearing in mind that P’ and P”’ belong to the region D) we have : 


RD AP) ee (I) 


We can construct a similar circle for every point P of the above 
region D; the radii e (P) of these circles will, of course, differ from 
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one another. Let us now imagine that every point P of the region D 
is surrounded not only by our constructed circle of radius p(P) but 
also by another concentric circle with radius equal to half of the 
radius of the constructed circle, viz. $p(P). This circle is called the 
proper circle of the point P. 


Owing to the fact that each point P of the region D has a proper 
circle, therefore the set § of all proper circles will cover the region D. 
It therefore follows from theorem 3 of the previous paragraph that 
there should exist 'a finite group C;, C.,..-, Cr of proper circles 
which would also cover the region D. Each of these circles Cx has 
its centre at P;, and radius equal to 49(P,). Let us denote by 5 the 
smallest of these n radii. 


Let P’ and P” be two arbitrary points of the region D which 
are at a distance 


ep (P', P’") <8, 


and let the point P’ belong to the circle C;, with centre at P;, and 
radius 49(P;). We then have 


e (P'; Px) < £e(Px), (2) 
whereas for 5 < 40 (P;,), 
e (P’, P”) < 30 (Px); (3) 


it follows from (2) and (3) that 
p eee P,) < p (2)5 


i.e. the point P”’ belongs to the circle with centre at P, and radius 
o (Px); and since the point P’ also belongs to that circle therefore 
the inequality (1) holds. But eis arbitrarily small and P’ and P’’ are 
two arbitrary points of the region D which are at a distance less 
than 8. Therefore the function f(x, y) is uniformly continuous in the 
region D, which was to be proved. 


We leave the reader to show that all results and proofs given 
in this paragraph can be extended without essential modifications 
to continuous functions of any number of variables. 


§ 89. Partial derivatives 


We shall now study the theory of differential calculus relating 
to functions of several variables and at first deal with functions of 
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two variables. Here again the evaluation of the rate of change of 
the function is very important; however, in this case the problem is 
much more complicated. Larlier the course of 
the process was described by the variation of y4 
one variable x and all we had to do was to | 

observe the rate of change of the function | 

y = f(x) when the variable received this or | iy 'y 
other increment; on the other hand, we are i 

now dealing with a point P(x,y) in a plane; ghia “dz 

this point can not only be displaced in distance Fig. 52. 

but also in any direction and it is clear that in 

general the rate of change of the function w = /(x, y) will differ when 
this point is displaced in different directions. Hence in order to 
solve this problem fully we shall have to analyse ali aspects of this 
complicated picture. 


. However, we shall at first only consider the simplest case when 
out of the two coordinates x and y of the point P only one changes 
while the other remains constant so that the point P is displaced in the 
direction of one of the coordinate axes. Let, for example, the vari- 
able x receive an increment Ax while the variable » remains constant 
so that we go from the point Pix, y) to the point P’ (x + A x, 9) 
(fig. 52). The function u == f(x, y) evidently receives in this process 
the following increment 


Au= f(x + Ax, ») — f(% 9). 


The ratio A u/ A x thus gives us the average rate of change of the 
Junction u with respect to the variable x tn the interval (x, x + Ax) for the 
given constant value of the variable y. If the following limit 


im Lie AM ym fl) 
Ard 4* px50 ze 


exists for A x—> 0, we can evidently regard it as the local rate of 
change of the function u = f(x, y) with respect to the variable x at the point 
P(x, y). It is obvious that x and y are constant in this limiting 
process, while Ax alone changes. However, the magnitude of the 
limit will evidently depend on the chosen values of x and y; 
generally speaking it will be different at different points (x, y) and, 
like u, it is a function of x and y (that is why we speak of the local 
rate). This quantity is known as partial derivative of the function 
u = f(x,y) with respect to x and denoted by du / 0% or f(x,y) / Ox 
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or f’x(x, y). In the first case the letter 0 (round) and in the second 
case the lower index x show that we are differentiating with respect 
to one of the two variables while the value of the other remains 
unchanged (fixed). 


Thus 





> X; z) 
22162) f4t55) atin, SY atin LE an = Sed, 
ox ox +9 Ax Ax>0 Ax 


Similarly the following quantity 





au _ Af) or ey) tim AY tim SP + AN Loa), 
ayy Ay>0 AY meee Ay 


is known as partial derivative of the function uv = / (x.y) and 
expresses the local rate of change of this function with respect to 
the variable y; here the rate of change of u is involved when the 
point P (x, y) is displaced in the direction of the OY-axis. Hence by 
knowing both partial derivatives 9u/ax and Qu/dy at the point P we are 
evidently able to judge the rate of change of the function u = f (x, y) 
when the point P (x,y) is displaced in the direction of one of the 
coordinate axes; however, from partial derivatives of a function we 
cannot judge about its rate of change when the point P is displaced 
in other directions. 


From what has been said above it is clear that finding of 
partial derivatives of functions given in concrete form does not 
necessitate the use of any new methods. ‘Thus, in order to find, 
say, du/dx it is sufficient to find the usual derivative of the function 
u = f (x,y) with respect to x assuming y to be constant in this pro- 
cess, so that wu becomes a function of one variable x. 


Example. u = y* sin 3x, a = 34? cos 3x 


Partial derivatives of a function of two variables can be readily 
illustrated geometrically. The equation u =f (x,y) expresses a 
surface in three-dimensional space ; by giving yan arbitrary fixed value, 
for example y = 6, we concentrate our attention on a cross-section of 
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this surface by the plane y = 4; this cross-section is a flat curve 
whose equation has the form 


u = f (x, b) (1) 
(fig. 53). The partial derivative 
du/ax at anarbitrary point P (a, b) 
is the usual derivative of the func- 
tion f (x, b) with respect to x at the 
point @ and is therefore equal to the 
angular coefficient of the tangent 
to the curve (1) drawn at the point 
x =a (1. e. the tangent of the angle 
between the direction of the tangent 
and the positive direction of the 
OX-axis). 9u/dy can be illustrated 
in exactly the same way. Fig. 53 





Partial derivatives of functions of three or more independent. 
variables are determined similarly ; if, for example, 
u= f (x,y, 2), 
then \ 


OH _ dim LIX + 4% 9:2) —S lm 2) 
= lim - eon ee Eres 
0X Ax30 Ax 





ou/oy and Qu/dz are determined similarly. It is obvious that a 
function of x independent variables nas n different partial derivatives. 
Each of these derivatives expresses a local (calculated at the given 
poiat of the n-dimensional space) rate of change of the function in the 
direction of the corresponding axis of coordinates. This geome- 
trical representation can only be imagined visually for n = 1,2 


and 3. 


Not many exercises need to be done in connection with this 
paragraph. The student shculd only solve 5—6 problems chosen 
from among Nos. 66-81, Section VI of the Problem Book by B. P. 
Demidovich. 


§ 90. Differentials 


When we were studying the function y = f(x) of one variable 
x, each displacement of the point x to an arbitrary new point x > Ax 
corresponded to another quantity dy which is called differential 
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of the function y corresponding to the given displacement of the 
point x. The differential dy is defined as the product f’(x) Ax and 
has the following two properties: ({) it is proportional to the 
displacement Ax of the point x and (2) when Ax — 0, it differs 
from the increment Ay =/(x + A x) — f(x) of the function » 
by an infinitely small quantity of a higher order as compared to 
Ax. Many applications of the differential are based on these two 
properties. We have also learnt that these two properties fully 
define the differential of the function y so that no other dy possessing 
the same properties can exist. 


While dealing with a function u = f (x, y) of two variables it 
is desirable to construct a quantity possessing analogous properties. 
Let us assume that we go from the point P (x, ») to another point 
P' (x + Ax,» + Ay). Letus denote by e = Var + Ay the 
distance between these two points. We wish to construct a quantity 
which would play a similar part for the function u = f (x, y) as the 
differential for functions of one variable and correspond to the 
transition (displacement) of the point P to the point P’. Since the 
differential of one variable has the form A Ax, where A is independent 
of Ax, (but generally it depend on x) therefore, in this case, the 
quantity du should be a linear combination of the increments Ax 
and Ay, 7. ¢. it should have the form 


du=AAx+BA), (1) 


where A and B are independent of Av and Ay (but they generally 
depend on x and y). This condition evidently corresponds to the 
first of the above properties of a differential. Its second property 
involves the fact that the difference between the increment and the 
differential is an infinitely small quantity of a higher order as 
compared to the magnitude of the displacement which in the 
first case is measured by | Ax]| and here by the distance 
eo= V Ax + A y*® between the points Pand P’. Therefore in the 
transition from the point P to the point P’ it is necessary that the 
differential du of the function u = f(x. y) should differ from its 
increment Au = f(x, + A x,y + A») —/f (x, 9) by an infinitely 
small quantity of a higher order as compared to p. 





Both these conditions can be combined if we accept the 
following definition, 


The differential du of the function u = f (x, y) at the point P (x, y) 
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is an expression of the form (1), where A and Bare independentof Axand Ay 
ffrre=V Art A P+ 0 


Au — du = 0 (o) (2) 





where Aw is the increment of the function u received in transition 
from the point P (x, y) to the point P’ (x + ax,y + AJ). 


The coefficients A and B cannot be determined directly from 
this definition and we can draw no conclusions as to existence and 
uniqueness of the differential of the given function u = f(x,y). We 
shall now consider these problems. 


Theorem 1. Jf the function u = f (x, y) has the differential (1) at 
the point P (x, y), then both partial differentials Qu | dx and Qu | 0» also 
exist al that point and A = Qu | @x, B = Qu | Oy, So that 


Ou Cu 
du = —— — AY. 
ax Axt a9 y 
Proof. Let x receive the increment Ax while » remains cons- 
tant (A _y = 0) 7.e. we displace the point P in the direction of the 
OX-axis; we thus have du = A Ax and therefore 


Au =du+o(p)=AaAx+t+o (Ax), 


Since in our case we evidently have p = | Ax|. Therefore 


Au _ fle + Ax y) — filer) _ o(L Ax |) _ 
ax Ax SOT ee are ot) 


when Ax — 0, the limit of the right-hand side is equal to A; hence 
the left-hand side also has a Limit which is also equal to A; in other 
words, ¢u / 0x exists and is equal to 4; we can prove similarly that 
du / dy exists and is equal to B. Hence theorem | is proved. 


Uniqueness of the differential follows from theorem 1. 


Theorem 1 shows that, as in the case of functions of one varia- 
ble, existence of a differential implies existence of the partial deri- 
vatives gu / gx and qu / dy. In the case of functions of one variable 
the converse proposition is also true: existence of a derivative implies 
existence of a differential so that we can define differentiability of a 
function either by existence of a derivative or of a differential, since 
these two definitions are equivalent; it is therefore natural to ask a 
similar question in the case of functions of two variables: let it be 
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given that the function uw = f/(x,y) has both partial derivatives 
gu / ox and Qu / @y at the point P; does this fact imply existence of 
the differential du at that point? It is not difficult to foresee that 
this condition is not compulsory in this case; with functions of one 
variable the derivative fully describes the rate of change of the func- 
tion; in the case under consideration the, knowledge of gu / 0x and 
du / 0» only makes it possible to determine this rate in two out of an 
infinite number of possible directions; hence it only describes vari- 
ation of the given function to a very limited extent. 


It can be readily shown that, in general, existence of partial 
derivatives at a given point does not, in fact, guarantee existence of a 
differential. Let us consider the function u = f(x, 7) = V/ay[in 
the neighbourhood of the point (0,0). Since w= 0 everywhere 
along the OX and OY axes, therefore @u / @x = 0 and Qu / dy = Oat 
the point (0, 0). If the function w would have had a differential at 
that point, then, according to theorem 1, we should have for every 
Axand Ay 


du =O; 


it therefore follows from (2) that Au =o (9). But if we choose 
Ax = Ay > 0, we have: 


o= VATA P=AxV2, Au= f(Ax, Ax)—f (0,0) =A, 


and when Ax-—>0O, the increment Aw is of the same order of 
smallness as compared to the displacement g. We thus arrive at a 
contradiction which shows that the function u does not have a diffe- 
rential at the point (0, 0) although both its partial derivatives exist 
at that point. 


Therefore in the case of functions of two variables existence of 
a differential is a stronger condition than that of partial derivatives. 
However, we must regard cases when there exist partial derivatives but 
no differentials as exceptions rather than the general rule. This is 
shown by the following theorem which assures existence of differentials 
in many real cases. 


Theorem 2. [fat the point (x, y) the partial derivatives Qu | Ox and 
ou | oy of the function u = f(x, y) exist and are continuous, then the func- 
tion has a differential at that point. 


Obviously the condition that the functions gu / @x and gu / ay 
are continuous implies that these functions also exist in a neighbour- 
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hood of the point (x, y) (in a circle with centre at (x, y) and a suffi- 
ciently small radius), for otherwise continuity of these functions at 
the point (x, y) would be void. 


Proof. Assuming that P = +/ Ax® + Ay", du= Qu/ax. Ax + 
+ du/dy. Ay we must prove that for p > 0 
Au — du =o (p). 
We have: 
Au=f(xt ax, rt Ay)—f (% = 
=f (x+Ax,y+A) fp (x, pt AD) +h (% +A Y)—f (x;y). (3) 
The right-hand side of this equation contains the sum of two diffe- 
rences. Let us consider the first of these. ‘The second argument of 
both terms has the same value y + Ay; we can therefore regard 
this difference as the increment Ax of a function of one variable x. 
If | Ax|and|A_y| are sufficiently small, then this function has a 
derivative at every point of the interval (*, x + Ax); this derivative 
is nothing but the partial derivative of the function u with respect 
to the variable « in the immediate neighbourhood of the point (x, 9) 
whose existence is preassumed. We can therefore apply the theorem 
on finite increments (§ 36) and write 
fat ax, ytd I)—Sf(% IFAI=f'e (TOA IFAD), 


where 0 < 6, <1. Similarly we obtain for the second differenée on 
the right-hand side of the equation (3) 


Ss, 9 + AD) —f (9) = Sy (% I+ AD); 
where 0 < @2 <1. Hence equation (3) gives: 
Au=fiilx+ Ary + Ay) AX +S y(% 9 + O2 AAD, 
and consequently 


Au—du = [f'2(x+0,A%, 9+ Ay) —Sf'alx, 9)] A+ 
+[f'y(*, y+ Oe Ay) —S'u(%,9)] Ad 


and since evidently 
|ax| <p, |Ay| <P, 
therefore 


Ane < | faletOaw yt Ay)—f'elx, 9) | + 


aes lf ‘u(x, p+ 00a ”)—f lx, 9)|- 
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Since the functions f’,(x, y) and f’,(x,_y) are continuous at the point 
(x,y), therefore both terms on the right-hand side tend to zero for 


e -> 0; we therefore have 


lim At = du _ 4 
e->0 Pp ‘ 


or, which is the same, 
Au = du + o(p); 


this proves that du = Gu/ax. Ax + du/ay. Ay is the differential of 
the function uw at the point (x, 7). 


Let us also make the following remark. If we have 


u= f(x,y) = *, 


then 


and consequently 
du = dx = AX; 


similarly by considering the function « = y we arrive at the conclu-- 
sion thatdy = A y- Hence in this case, as in earlier cases, the 
increments of the independent variables and differentials are 
equivalent to one another. This also shows that the differential of 
the function uw, in case it exists, can be written in the form 


oe dy 

Owing to the fact that with functions of two variables existence 
of a differential is, in general, not equivalent to existence of partial 
derivatives, the question naturally arises, when the function of two 
variables is differentiable at a given point. The answer to this 
question is, to a certain extent, provided by what we have learnt so 
far. As we know, the differential describes the behaviour of the 
function during displacement in any direction whereas partial 
derivatives only tell us as to what happens when the point is 
displaced in two well defined (mutually perpendicular) directions 
(the partial derivatives may even disappear when the coordinate 
axes are rotated about the given point). It is therefore natural to 
say that the given function / (x, y) is differentiable only at points where 
it has a differential and we cannot be satished by the mere existence 
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of partial derivatives. The usefulness of this definition of differenti- 
ability will be confirmed on many future occasions and paricularly 
in the next § 91. 


The concept of differential and all its properties can be 
extended without essential modifications to functions of three or 
more variables. ‘Thus in the case of the function u = f(x, y, z) we 
define the differential du at the point (x,y,z) by the following 
expression 


du=AAx+BAy7+C Az, 
where A, B and C are independent of Ax, Ay and Az provided 


we can readily show that for existence of the differential it is 
necessary that A = Qu/dx, B = Qu/dy, C = du/az. In particular, 
dx = Ax, dy = Ay, dz = AZ, so that 

Bt ay 4 
ox oy 
‘The function u which has a differential at the point (x, y, z) is said 
to be differentiable at that point. Existence of partial derivatives 
of the function uw at the point (2, y, z) does not guarantee its 
differentiability at that point; however, if all three partial derivatives 
at the point (x, y, z) are continuous, then the function x is differentiable 
at that point. 


Cu 
— d — dz. 
du y+ ae 


For exercises to § 90, ¢{ Problem by B.P. Demidovich, Section 
VI, Nos. 96a, 97a, 104. 


§ 91. Derivatives in arbitrary directions 


We have already said on several occasions that partial 
derivatives of functions of two variables only define the rate of 
change in the direction of the axes of 
coordinates ; there are no general reasons 
for isolating these two directions from 
among all other possible directions; we 
must therefore now consider the rate of 
change of the function u = f(x, y) when’ 
the point (x, y) is displaced in an arbitrary 
direction. 





‘ 
Let us draw a straight line through 2 
the point P(x, y) to make an arbitrary Fig. 54 
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angle @ with the positive direction of the OX-axis (fig. 54) and move 
from the point P(x, y) to an arbitrary point P’ (x +Ax,y + A?) 
which lies on the drawn straight line. The distance ep between the 
points P and P’ is evidently equal to Ax? + Ay”. Dividing the 
increment Au = f(x + Ax,» +Ay) — f(x, 7) received by the given 
function in the transition from the point P to the point P’ by the 
distance p between these points we obtain a quantity which can be 
regarded as the average rate of change of the function in this transi- 
tion ; if this average rate tends to a definite limit for ¢ > 0, then this. 
limit should be regarded as the (local) rate of change of the function 
at the given point in the direction determined by that of the drawn 
straight line which, for the sake of brevity is called as the “direction 
”’. This limit, in case it exists, is called the derivative in the direction 9. 
of the function u = f(x, y) at the given point (x, y) and denoted by 
Do f(*, 9) or Deu. 


Hence 


Dof (x, ») = lim (*% t AMD Ste A») ~ FI) 


6-0 ep 


e>0 
where p = VW Ax? + Ay? and where it is assumed that Ax and 
Ay change in such a way that the point (x + Ax,» + Ay) always 
lies on the straight line drawn in the direction 9 (for this to be so 
it is evidently necessary and |sufficient that we should always have 
A»y/Ax = tan 9). It is clear that the partial derivative @u/gx is the 
common value of the quantities D,uw and—D,u when these two 
quantities coincide; similarly @u/dy is the common value of the 


coinciding quantities Dzuand — Dy-u. 
= 3 


Let us now assume that the function u = f (x, y)is differenti- 
able at the point (x, »), 7.¢. that it hasa differential which, as we know, 
is equal to 


Ou ou 
da = -— ,! —_—- 
sa aa ta 


and in the transition from the P to the point P’ 
Au=f(x + Ax,y + Ay) —f (x, 9) = du + 0 (0), 


hence 
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Or, since A x = pcos”, Ay =osin 9 (¢f fig. 54), therefore 


* == cwos9 + ° “sing + 22) 


When the point P’ approaches indefinitely close to the point P 
in the direction 9, i.e. when ¢ — 0, the first two terms on the right- 
hand side of the above equation remain constant while the third 
term tends to zero. We therefore obtain in the limit : 

All <. ou 
ee 





Deu = lim 


du 
os — ; 
aia @ -+ ag? 


We have thus proved the following proposition which evidently 
confirms the usefulness of the chosen definition for differentiability of 
functions of two variables. 


Theorem 1. If the function u =f (x, _y) is differentiable at the point 
P, then it has derivatives in all directions 2 at that point and 


Dou = © cosg + 5 sin 2. 


We can thus see that for a function to be differentiable it is 
necessary to know the partial derivatives (i.e. the derivatives in two 
mutually perpendicular directions) ; ‘this enables us to write down 
the expression for the derivative in any desired eirechion without 
performing additional calculations. 


When the given direction is changed to the directly opposite 
direction (7 e. from © tog + =~), both cos 9 and sin 9 change their 
signs ; we therefore have for any direction 9? : 


Doy- (u) = — Do (u), 


2.e, the absolute values of the derivatives in two mutually opposite 
directions are the same but have opposite signs. We already saw 
that this holds for derivatives in the direction of the coordinate axes. 


Let us now consider the same problem for a function of three 
independent variables u = f(x,y, z). Let us draw a straight line 
through the point P(x, y, z) to make angles a, B and Y respectively 
with the coordinate axes and take an arbitrary point P’ (x + Ax, 
y + AY, Z+ AZ) on that line. Let us denote by 





p= VAP FAP FAL 
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the distance between the points P and P’ ; we evidently have : 
Ax =ocosa, Ay =Pcosh, AZ = Pocosy. ; 


Let us now assume that the function uz is differentiable at the 
point (x, y, z) so that for ep > 0 


Au=f(x+ Ax y+ Ay, 2+ AZ) —f(4y, Z= 


= P COS & +2 P cos B +22 ecosY + o(P). 
If the point P’ comes indefinitely close to the point P while 
always remaining on the drawn straight line, we shall have e > 0, 


while the angles «, 8 and Y remain constant ; we therefore have : 


fig eee cos @% + of of 


— cos Y. 
p—>0 er ox Oy 


cos B + 
This limit, as in the case of functions of two variables, evidently 
describes the local (at the point P (x,y, z)) rate of change of the 
function w during the displacement of the point P in the chosen direc- 
tion which is characterised by the angles «, 8 and Y. ‘Therefore we 
can in this case also say that the above limit is the derivative Du of 
the function w in the givendirection. Thus if the function u =f (x, 9, Z) 
is differentiable at the point P, then it has a derivative Du at that point in any 
direction (a, 8, VY) and 


ou Ou 
Du = Ox COS & or cos B + 57 cos”: (ly 

For exercises to § 91 ¢f. Problem Book by B.P. Demidovich, 
Scction VI, Nos. 198, 199, 201. . 


§ 92. Differentiation of composite ond implicit functions 


We shall now consider two problems dealing with the usual 
differentiation of functions of one variable which we could not study 
at the time, since their solution requires knowledge of the methods for 
differentiating functions of several variables. 


1. Let u= f(x,y) be a function of two variables x and y. 
whee each is regarded not as an independent variable but as a func-. 
tion of a new variable t: x = 9 (t), y = wv (t) (which isthe same in 
both cases). We thus have 


w= fT? (),9@)] 
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which is now composite function of t. We must find the derivative 
du/dt of wu with respect to the independent variable ¢ from the partial 
derivatives Qu/éx and du/ay and the derivatives dx/dt= 9’ (¢) and 
dy/dt = v' (t). Weare given that all these derivatives exist but exis- 
tence of the required derivative du/di must be proved. We shall 
assume with regard to the function f (x, y) that it not only has partial 
derivatives but also differential at the point «=¢ (#), y = w (t). 


Let the increment Af of ¢ correspond to the increments Ax 
and A » of x and y which in their turn correspond to the-increment 


Au of u. Let us assume that / A x? + Aj? =e. We know 
that 





Aus dutol)=& ax rt PAs tap 
where « — 0 fore > 0. Therefore 
AU __0u Ax fr BD sg an / 2 
Al ox At ay at ~ eo. o2y. (1) 


Let us now assume that Af—0. Therefore Ax >OQOand A y>0 
(since x and » are differentiable, they are also continuous); hence 
e—> Oand also «+0. But since, on the other hand, the deriva- 
tives Qu/dx and @u/d» are constant for Azt-— 0 and the ratios 
Ax/At and A »/At tend to the limits dx/dt = 9'(t) and dy/dt = W’ (t) 
respectively, therefore the right-hand side of the relation (1) has the 
following limit for Ai— 0: 

Ou ax ou dy 

ax dt! ay dt" 


; du . Au : 
This proves that 4, eae Al also exists and 
—> 


dt axdi ' dydt* (2) 
This simple formula evidently solves our problem. 


The following case which often appears in applications deserves 
special attention, z7.¢. when x == ? (t) = 1#, 2.¢ when the new 
variable ¢ is the same as one of the old variables. This means that u 
is given as a function of two variables x and y, where x is the 
andependent variable and » = ¢ (x) is a given function of x: u= 
fl, ¥ (x) ]. Assuming in formula (2) that dt == dx'we obtain : 


du_ ou , dud 
dx Ox ° Oydx’ (3) 
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The left-hand side and the first term on the right-hand side of this 
formula represent the derivatives of the function u with respect to 
the independent variable x; however, these derivatives do not 
coincide with one another, for they are found on different bases : 
du/Ox is the partial derivative of u with respect to x, 7. e.jit is calculated 
on the assumption that y remains constant; ‘on the other hand du/dx 
is a “full” derivative of u with respect to x, i.¢. it is evaluated on 
the assumption that y = (x) changes in a quite definite manner 
as x changes. Formula (3) clearly shows the importance of different 
symbols used for denoting partial and full derivatives. 


Example. u =9 =V/l—x; 


The problem of the derivative du/di when u is given as the 
differential of a function of any number of variables, each of 
which, in its turn, is a differentiable function of ¢, is solved in 
exactly the same way. Thus when u = f(2, y, z), x=o(t), y= (£), 
z= X(t), we have: 
oudy, Oudz Qu, 


Ou ,, ou, 
Taw dt arr Cda® (t) + ay +5 eM). (4) 


Gi OE 

dt Ox dt 
The reader will have no difficulty in deducing this formula in the 
same way as formula (2) is deduced above. 


In all the cases which we have considered so far the problem 
involves one independent variable (which is denoted by #). However, 
it often happens in applications that there are several independent 
variables. Let us assume that we have, as above, u =f (x, 9) 
but let this time « and y be functions of two variables x = ° (t, s), 
y= (t,s) In this case u= f[ ? (é, 5), b (¢, 5) ] also becomes 
a function of the same variables; we thus have a composite function. 
Our problem involves the [following : we know the partial deriva- 
tives of the function f (x, y) with respect to x and y and also the 
partial derivatives of the functions 9 (¢, s) and } (¢, s) with respect 
to tand s; we are required to find the partial derivatives of u with 
respect to ¢ and s. Since partial differentiation does not differ in 
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any way from ordinary differentiation (but is carried out under 
definite conditions), this problem does not require further consi- 
deration. It is solved by means of relations analogous to formula 


(29% 
gu guex , away 
ae axel Oy et ’ 
gu_guex | way, 
cs ewes Oy Os 7 


we obtain similar results when the number of intermediate functions 
or the number of independent variables is greater than two. 


2. Let us now consider the second problem. We are given 
an arbitrary equation with two variables 


F (x, 9) = 0. (3) 


Generally speaking this equation defines one or _ several 
functions y of the independent variable x *); thus, for example, the 
equation 


xy — 2x + 3y~1=0 


defines one function y=(2x+1)/(x+3) and the equation x?-++)?—1=0 
two functions: y= + Vl — x and y = — V1 — x **); many 
cases are known when functions defined by the given equation (5) 
cannot be expressed in terms of x by means of elementary formulae 
in the way it is done in the above two simple examples; however, 
regardless of whether such an expression is possible, every function 
y =f (x) which within a region of values of x identically satisfies the 


*) The conditions under which this takes place will be considered in detail 
in chapter 24. 





**) Strictly speaking we only obtain two functions when we restrict ourselves 
to continuous solutions of the given equation. The above equation defines an infinite 
number of discontinuous functions. Any one of the following functions is a solution 
of this equation : 


-~V1I-x® (-1ge< a) 
I= — 
+V°— 2 (#gx<)), 
where «@ is an arbitrary number between — 1 and + 1. The most general solution 
of the above equation can be written as follows: y = w (x) 4/1 — x2, where 


V1—+x* > Oand W (x) is an arbitrary function which only takes the values + i 


and — I. 
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equation (5) is said to be an implicit function described by this equa- 
tion. It is our problem to find derivative of such a function. 


Let » = f (x) be an implicit function given by the equation (5) ; 
we therefore have in a region 


F (x, f (x)] = 9, 


for every x and therefore in this region we also have 


dl? [x. f (x)] 0 
dx 


for every x. Let us now assume that both the functions F (x, y) and 
S (x) are differentiable; we then obtain from formula (3) : 


dF (x, f(x)]_ OF | oF ad, 
dx ~ ax | Oy dx’ 


hence when y = f (x) we have in that region 





oF . ak dy 
ox Bs oy dx = 


and therefore 


oF 

dy _ x 

dx oF (6) 
oy 


(provided, of course, that oF / a» + 0). 


This formula solves our problem. However, we must make 
the following remark. It may appear strange that we have succeeded 
in finding a ‘‘definite” expression (6) for the derivative dy/ dx though 
we were unable to express the function itself in a ‘“‘definite’’ form, 
i.e. to solve the equation (5) with respect toy. The solution of this 
equation would require that y should be expressed in terms of x by 
means of an elementary formula; it would indeed be strange if we 
were unable to do this for the function y, while we could always do it 
for its derivative dy { dx; however, formula (6) does not give us such 
an expression for dy / dx; since ¢F { 0x and oF / dy are given as func- 
tions of two variables x and y, formula (6) expresses the derivative 
dy {| dx in terms of these two variables. Hence if we do not know a 
definite expression for the function y in terms of x, then formula (6) 
cannot give us either a definite expression in terms of x for the deri- 
vative of this function. 
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Nevertheless, formula (6) which establishes a connection bet- 
ween the derivative of an implicit function and the partial deriva- 
tives of a function of two variables which describe it is of great 
importance in theory and has many important applications, some of 
which we shall consider later. 


Example. Let yy be an implicit function of x given by the 
equation 


F(x, 9) = xy5 — Py — 2 = 0; 
we have: 


PF 
Ce Ee 5x1y, - = 5xy* — x5, 


Ox 


and formula (6) gives: 





For exercises to § 92 ¢f. Problem Book by B. P. Demidovich, 
Section VI, Nos. 137-139, 222-226, 229, 231. 


§ 93. Homogeneous functions and Euler theorem 


A polynomial P (x, y) of two variables is said to be homoge- 
neous if sum of the indices of the variables x and y of all its terms 
has the same value £; the latter is known as degree of homogeneity of 
the polynomial. Thus the polynomial 


ax? +. bx? y + cxy? + dy? 


will be homogencous of degree 3 regardless of the coefficients a, b, ¢ 
and d. 


If P (x, y) is a homogeneous polynomial of degree k, we evident- 
ly have for every ¢ (and for all x, y) 


P (ix, 9) = #P (x, 9). 


This property of homogeneous polynomials is very useful for the 
development of the concept of homogeneous functions. We shall 
agree to say that a homogeneous function of degree k is a function f (x, ) 
which identically satisfies the following relation (7 ¢. for all values of 
Ks 9y-8)5 


S (tx, ty) = tf (x, 9). (1) 
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In contrast to polynomials the index fk can, in this case, have 
any real value; it is self-evident that in such cases ¢ can only take 
values for which ¢* has a definite meaning; thus, for example, we 
should have ¢ 4 0 for k < 0,¢ > 0 for k = 3, ete. 


Examples. (x? + y*)/(« +9), (x—y)l(x +9), (x +p)/(@? +9) are 
homogeneous functions of degrees respectively equal to 1, 0 and —1. 


The following simple and very ccnvenient relation developed 
by Euler holds for partial derivatives of homogeneous functions. Let 
J (x,y) be a homogeneous function of degree k. We shall assume 
that x and y are constant in the relation (1) while ¢ is variable so that 
both sides of this relation are functions of t. We can then differen- 
tiate the identity (1) with respect to ¢ On the left-hand side we 
evidently have a composite function of t whose derivative can be 
found by means of formula (2) § 92: assuming that tx = u, ty = 2, 
we obtain: 


df (u, v) Of (uv) du, af (u; v) dv _ ZT) ies af (u, v) 
di au dt jv. dt ~ ou av 


The derivative of the right-hand side of the relation (1) is equal to 
kt*-! f (x, y) ; the two derivatives obtained are equal to one another 
for all values of x, y, 4; assuming, in particular, that ¢ = 1, we obtain 
u = x, v = y and therefore 


CAG? DY. a iss Of (x59) 
Ox oy 





a (x, 7). 


This is Euler’s relation. The same method can be readily used for 
finding analogous relations for homogeneous functions of any number 
of variables: we shall only state the result for functions of three 
variables. 


The function f(x,y, z) is said to be a homogeneous funclion of 
degree k if the following relation holds identically : 


S (tx, ty, tz) = if (x,y, 2)5 


if this function is differentiable, we have: 


vil of 


T Jay ay = 


+ £5 = If. 


For exercises ¢f. Froblem Book by B.P. Demidovich. Section VI, 
No. 93. 
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§ 94. Partial derivatives of higher orders 


The partial derivatives gu /0x and du / dy of the function 
u = f(x, y) are functions of the same variables x and y on which u 
depends. Therefore the operations of partial differentiation with 
respect to either of these variables can again be applied to these 
functions. The partial derivatives with respect to x and y of the 
functions gu / dx and gu / dy are said to be derivatives of the second 
order with regard to the initial function wu. Each of the derivatives 
ou/ox and d@u/dy gives rise to two derivatives of the second 
order so that we obtain in total four derivatives of the second order 
usually denoted as follows : 


0 fou Oru ‘i 

gelax) = age ~S' ( 9) 
2 

Ge = ae = lees 





ay\ox/ ——-OxOy 


Cy G7) i ne ee 
a(S) = Oy ox =f yr (5 7)s 


oy 
a fou = Oo" u ye 
ay = ae ay" t yy (ae 


Each of these four derivatives of the second order is a function of the 
game variables x and y and can in its turn have partial derivatives 
with respect to these variables which we shall call derivatives of the 
third order of the function u; derivatives of the third order are 
defined in exactly the same way as above so that no additional 
explanations are needed ; thus , 


3 
| =f" exy (% 9) 

denotes a function obtained as a result of differentiating the function 
u == f(x, y) three times where the first two differentiations are carried 
out with respect to x and the third differentiation with respect to y. 
In general the partial derivatives of the first order of any derivative 
of order n are said to be partial derivatives of order n+ 1 of the 
function u and denoted in the way described above. It is evident 
that for a function of two variables the number of derivatives of the 
third order is equal to eight and, in general, the number of deri- 
vatives of order n is equal to 2”. Partial derivatives‘of higher orders 
are very important in mathematics of accurate nature study; they 
are also extensively used in mathematical physics. 
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Partial derivatives of higher orders possess one very important 
property which considerably simplifies the set of these derivatives 
and their formulae. This property is due to the fact that if two 
partial derivatives of the same order differ from one another only by 
the order in which differentiation is performed and if they are both 
continuous, then they are exactly alike. 


Let us at first consider derivatives of the second order. The 
functions f’’zy (x, y) and f''ye (x, y) are obtained from the function 
u= f(x, y) as a result of two differentiations. In both cases one of 
these differentiations is with respect to x and the other with respect 
to y; the only difference is due to the order in which these differenti- 
ations are performed. We say that if at a certain point (x, y) the 
funtions f"’;, and fy, are both continuous, then 


Lo vy (Hs 9) = Sun (Hs 9) 
In order to prove this let us consider the expression 
A= fet Ax, y+ Ay)—f (xt Ax, f(x, pt AD) +S (4, 9): 
Assuming, when » and A » are constant, that 
Say + AY) — f(s 9) = (4) 
we can evidently write 


= 0(x + Ax) — 0(2). (1) 


Existence of the second derivatives of the function f implies 
existence of the first derivatives in the neighbourhood of the point 
(x,y); therefore the function © (x) is differentiable in the interval 
(x, x + Ax), provided A x and Ay are sufficiently small. Applying 
the theorem on finite increments to the right-hand side of formula (1) 
we obtain : 


A=? (x+ 9, Ax AX, 


where 0 < 6, < 1. But it follows from the definition of the function 
o (x) that 


p' (x) = f'n (x,y ae AY) — f'n (% Dr), 


so that we obtain ; 


A=[f'cls +O Ax, y+ Ay) —f' a(x+0 Ax, TAX. (2) 
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But, on the other hand, the application of the theorem on finite 
increments to the difference in the square brackets on the right-hand 
side of the above equation evidently gives : 


Sia(e + Oi Axy + Ayr) — fs + 014%) = 
=f" ay (% +01 AI + 62 A7) AY, 
where again 0 < @, <1. Therefore the relation (2) gives: 
A=flu(e t+ O,Aax yt Ors AN AXAD. (3) 


Let us now return to the initial expression for the quantity A 
and transform it in another way. Let us assume that 


f(x + Ax, 9) —f(% 9) = ¥(9), 
so that 
A= ¥(y + Ay) — $9), 
or, applying the theorem on finite increments, 
A=V(p thay) Ad; 


where 0 < #3 <1. It follows from the definition of the function 
w (y) that 


v(y) =f'y(e + Ax, 9) — fy (% 9»), 
and we obtain : 
A=([fulxtAuyt 0:49) —firley + OANA, 
or, applying again the theorem on finite increments 
A=fly(*teAny t+ OsAr)AxAy (0< 64 <)). (4) 
Comparing the equations (3) and (4) we obtain for A x Ay 40 
Sole tO A, IO.) =f" ye XFOA%, IT OA 9). 


Let us now assume that Ax and Ay tend to zero so that we always 
have Ax Ay <0. Since, according to our assumption, the functions 
Sfx and fy, are continuous at the point (x, y), therefore the limiting 


process gives : 
Fay (Xs I) == fue (4 D)s (5) 
which was to be proved. 


Let us now consider the general case. Let us assume that we 
have at first two partial derivatives of the same order n > 2 which 
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differ from one another only in that in the first of these derivatives 
two consecutive differentiations are carried out in an order reverse 
of the other, for example 


5 5 
va gayeys cé ) eyrens 


where the difference is due to the commutability of the second and 
third differentiations and all other operations are carried out in 
exactly the same order in both cases. However, it follows from the 
above proof that two such derivatives are exactly alike (in view of the 
necessary condition of continuity); thus, by applying equation (5) 
to the function f’, (x,y) in our example, we obtain : 


vee —- fie % 
¥ ary =f “yrs 


continuing differentiation on both sides of this equation first with 
respect to x and then with respect to y, we obtain an equation for 
the two given derivatives of the fifth order. 


However, in the most general case when we are given two 
arbitrary derivatives of order n which differ from one another 
only by the order of differentiations, we can evidently pass from 
one to the other by exchanging two successive differentiations. Since 
these commutative operations leave the derivative unchanged, the 
two derivatives will remain alike. 


The proved proposition considerably reduces the number of 
different derivatives of order n and gives a better insight into the 
set of these derivatives. In fact, if the order of differentiations is 
irrelevant, then we can evidently obtain any desired derivative by 
differentiating first with respect to x and then with respect to » for 
the required number of times; therefore any derivative of order ” 
of the function u can be represented in the form 


BCS 
Ox*Q y™-+ > 
where k is one of the numbers of the series 0, 1,..., 2. This shows. 


directly that the number of different derivatives of order n is equal 
to n + 1 whereas we had 2” such derivatives earlier, j.e. when n was 
large, the number of derivatives was many times greater. 


The definitions and notations used for partial derivatives of 
higher orders also hold for functions depending on three or more 
variables. ‘The possibility of changing the order of differentiations. 
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also holds for such functions provided the functions which are 
compared with one another arecontinuous. ‘The proof ofthis theorem 
follows directly from what is said above, since all changes in the 
order of the differentiations for functions of any number of variables 
can evidently be brought about by a series of commutative 
operations of two successive differentiations and such a change, as 
we have shown, leaves the result unaltered. 


For exercises to §94, cf. Problem Book by B.P. Demidovich. 
Section VI, Nos. 82,112,113,118-120,162,164, 166. 


§ 95. Taylor’s formula for functions of two variables 


All considerations which at the time (chapter 9) prompted 
us to represent functions of one variable by Taylor’s formula remain 
fully valid for functions of any number of variables: here, as before, 
‘it is very convenient both theoretically and practically to represent 
the given function approximately in the form of a polynomial of a 
given degree. On the other hand, our initial assumptions as to the 
validity of this representation are the same as before. At that time 
we obtained Taylor’s formula by developing the simple formula 


fla + h) — f(x) = hf'(x) + 0 (A), 


which holds for every differentiable function. For a differentiable 
function of two variables u = f(x, ») we have an analogous formula 


Au=f (xth, yt kf (m9) = hf a (Hs 7) FES ulm 9) +0(0); 


where p= VAx® + Ay% We have therefore good reasons for 
trying to obtain in this case an approximate expression for the 
quantity f(x + A,» +) in the form of a polynomial in powers of 
the increments A and k. ‘Taylor’s formuia could, in fact, be obtained 
by repeating with corresponding changes and complications the 
whole deduction which in chapter 9 gave us Taylor’s formula for 
functions of one variable. 


However, there is a much simpler and shorter way which wil: 
give us the desired result if, instead of starting from the very 
beginning, we assume that we have already established Taylor's 
formula for functions of one variable. This method is also conven- 
ient in that it is carried out in exactly the same way for functions 
of any number of variables and for the sake of brevity we only 
restrict Ourselves here to the consideration of functions of twe 
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variables. We shall assume that the values x and y and their 
increments A and & are constant and we shall consider the function 


9(t) =f lx + Aty + Ki) (1) 


of one variable ¢ in the interval O<t<I. Let us assume that the 
function f(x, y) has all partial derivatives inclusive upto the order 
n and ail these derivatives are differentiable at the point (x,y). It 
then follows from formula (2) § 92 that the derivative 9'(t) exists 
and is equal to 


OL ate TM) yas aly tM) nas 


- 
sO ar di ay di 


+ ke 








where both partial derivatives are taken at the point (x + At, y + kt). 
Applying the same formula to the function 9’ (t) and using the fact 
that as a result of (5) § 94 


hs Se a 


oxoy Ovex ? 


we readily obtain: 





o” () = Ate. Dt nk Af +h? rs, 


where again all partial derivatives are taken at the point (x + ht, 
y + kt). Using the same method we obtain further : 


a 0 nf 2 J SOS se G80 ee 
wot oar 3h? 3hk? : 
(t) = - 5 a at 
These formulae show that in case all constituent partial deri- 
vatives exist and are differentiable, the following general formula 
holds : 





n 
(n) — tT hn—rhr anf : 
pi” (t) = Len hetk ax" 9? (2) 
r= 


where all partial derivatives are taken at the point (x + At, y +kt). 
Formula (2) proved for n = 1, 2, 3 can be in general proved by means 
of induction from n to n + 1, as we shall now see; this proof is simple 
and clear in principle but it agolves rather bulky calculations. 


Let us assume that formula (2) is valid for a given n cee let all 
“its constituent partial derivatives be differentiable at the point 
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(x +-At, » + kt), Applying formula (2) § 92 to the function ¢"(t) we 
obtain : 


n 


(n+1) i= rpnreer ee ikiet A ples ene aren 
@ 0 (1 Ye. bere Sn Bt el 
T= 


n 


a” i ae 

= rpnt+l—rbr rhn—r Ertl 

y) Cah Maat ‘6, An? kre 
r=0 r=0 








= Q aim ~ ey ee 


In the second of these sums we shall change the index of summation 
‘by assuming that r = s —1; hence 


nti 
clan ae 
— sl pntl— ses _ 
d. Le. : : axrtl—sQ ys" 


s=1 
-or, denoting the new index of summation by 7 as before 


n+1 


as ae 
r—1 fnti-r br 
= > Cr h k oxttl-r oy” (3) 
r=] 
Let us also note the following fact: if we agree to consider for 
every n 


C,1 = C,"*! = 0, 


then we can sum fromr=0Otor=—n»n-+1 the sum 3, and the 
-expression (3) for X, without altering these sums in any way. We 
therefore obtain: 


n+1 
Coe 
(n+1) =— r—l n+1-—7 Lr 
gimeD (1, nee + CaM 
r= 


But‘ according to a well-known property of binomial coefficients 


Ch? + C,77) = Chai” (O<r<int+ 1); 


x 


_and we therefore obtain : 
n+1 
pire (1) = Yi Cuan AMET RT 
7r=0 


3 dae d 
ox n+l—r oy r 
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i.e. formula (2) remains valid when n is replaced by n + 1; this 
proves the formula in its most general form. 


It also establishes existence of a derivative of order n for the 
function 9 (i) if, as assumed, the function f(x, ») has differentiable 
partial derivatives inclusive up to that order. It therefore follows. 
that MacLaurin formula holds for 9 (Z) : 


? (t) = 9 (0) + #9’ (0) + 4-9" ()-te 


gr-l 
(n—1)! 


where the last term is written in Lagrange’s special form which is 
well-known to us from § 39; in oe fort = 1 





nae pir) (Q) + 9 (2) (62), 


(1) = 9(0) + 9°10) Pia 1 9" (0) +. 


1 
G@= 11 


whereO <9 <1. But 9? (0) = f(z, »),¢(1) =f(e@ +h,» + k), and 
the successive derivatives of the function ? for = 0 are expressed by 
formula (2) where all partial derivatives are taken at the point (x,y). 
We therefore obtain: 


Spee Or rs OU) 


soup. OF get Va NP 
f+ hy +h) = S52) + (hee + kX) + (RS 





ox* 
7; af n—1 
0 p20 oe ae 
2 Thn—-l—r Lr 
+ 2k oo + Boe) tat; 7m Vena 8+ ir ae 
r=0 





n 
i r =a ro" h(x Bue Gh, y a5 6k) 
Al VG, hn rk ax ay » (4) 


where 0 < @< 1 and where all partial derivatives except those 
which enter the last sum (last term) on the right-hand side are taken 
at the point (x ») (and are therefore independent of f and &). 


The last formula completely solves our problem, for it gives 
an approximate expression for f(x + A, y +k) in the form of 
a polynomial of degree n — 1 with respect to A and & and as 
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can be readily seen, the last term has the required form o0(p"-1) 
(p= Vh* + k2) sothat| hl <plki < 9 and consequently 


pAeTk |) Sp "=o (OSr< a). 


The notation chosen for this formula is rather bulky (although 
the formula itself is clear and can be readily remembered in spite of 
its outward complexity). This bulkiness becomes even worse when 
we consider functions of three or more variables. Therefore Taylor’s 
formula is often written in symbolic form. Let us write the following 
expression for an arbitrary natural number g : 


(i2 +e) Sf 


If we raise the binomial in the brackets to the q-th degree in accor- 
dance with the binomial formula and assume that @ is a number (and 
not the symbol of differentiation), we obtain: 








[Bevan ax or ;|f> Be Thor kr saea5P 


ze. (with an accuracy to the factor 1 / gq!) the g-th degree in Taylor’s 
formula. We can agree to write even more briefly 


(Ve ee) f= Lyf; 


thus L, becomes a certain definite operation to be performed over 
the function f which we have just described in full. By using this 
notation we can write Taylor’s formula in symbolic form as follows: 
n—1 
é 


fet hy +8 = Ye OF +62) pent 


q= 0° 
1 0 a \” 
+ (a5 + ke) S(x + Oh, » + 6k), 


or even more briefly 
n—-1 
fleth y+)= PLS +55 Lif (2-+6h, 9+ 68). 
q=0 
For exercises to § 95 cf. Problem Book by B.P. Demidovich, 
Section VI, Nos. 390, 391, 396, 398, 400, 406, 407. 
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§ 96. Extrema 


The maxima and minima of a function of any number of vari- 
ables in a given region of these variables are defined in exactly the 
same way as for functions of one variable. Here the concept of a 
local extremum is of fundamental importance : by this we mean an 
interior point in the given region at which the value of the function 
is not less (or not greater) than at any other point sufficiently close 
to the given point. As in the case of a function of one variable, a 
function can have an extremum either on the boundary of the region 
or atan interior point which will, in this case, also be a point of a 
local extremum. It is clear that in the space of several] dimensions. 
the problem is complicated by the fact that even in the simplest cases 
all boundary points, of which there is an infinite number, enter into 
competition (in the one-dimensional space the boundary consisted 
of only two points) ; we must therefore find the greatest or smallest 
value of the function on the boundary of the given region, ie. we 
must solve an additional extremum problem. In practice some 
material considerations often make it possible to determine beforehand 
that the function attains, say, its maximum value inside.(and not on 
the boundary of) the region and this considerably simplifies the solu- 
tion of the problem. We must, nevertheless, use differential calculus 
in order to find the points of the local extremum. 


If the function u == f(x, y) has a local extremum at the point 
(a, 6), then it is clear that the function 


of one variable x should have a local extremum at the point x = a. 
Let 1s assume that the function f(x, y) is differentiable everywhere 
in the given region; in that case the function 9(x)‘ evidently has a 
derivative equal to f", (x, 6) in a neighbourhood of the point a. We 
know from § 41 that therefore 9’ (a2) = 0, i.e. the partial derivative 
af/ox of the function f(x, y) should vanish at the point of a local 
extremum x = 4,y = 6. Similarly, an analogous argument shows. 
that we should also have @/f/0y = 0 at that point: Finally it can 
be similarly shown that the result obtained remains valid for functions. 
of any number of variables : if such a function ts differentiable in a region, 
th n partial derivatives with respect to all the variables should be equal to 
zero at every point of a local extremum (which lies within the region). 


. | 
In this case a stationary point is a point at which the partial 
derivatives with respect to all the variables vanish ; formula (1) § 91 
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shows that the derivative of the given function in every direction 
is equal to zero at a stationary point; hence a stationary point is, 
as it were, a point of minimum changeability of the function during 
a displacement in any direction ; this justifies the use of this term. 


Hence in the space of several dimensions, finding of extrema 
requires at first the knowledge of all stationary points of the given 
function in the given region. Ifwe have a function of 2 variables, 
then by equating the partial derivatives of this function with respect 
to all the variables to zero, we obtain a system of nm equations with 
nm unknowns and thus determine the coordinates of the stationary 
points. This problem can now be solved without further using 
differential calculus. 


Having found all stationary points we must, in the same way 
as in a one-dimensional case, investigate each point individually 
and determine whether it gives the maximum or minimum of 
the given function or neither. In the case of several dimensions 
this investigation is much more complicated and we shall here only 
give the first few steps for functions of two variables. 


Let P (a, 6) be a stationary point of the function u == f(x, 9) 
and let this function have all partial derivatives of the second order 
at the point P. Let us also consider the point Q (a + h, 6 + k) and 
denote the distance between these two points by ¢ so that 

oh + Kk; 
finally, let A, B and C denote corresponding partial derivatives 


Gee eur arf 
ox? > Oxdy’? O73? 





at the point P. It follows from Taylor’s formula ((4) § 95) that we 
have for p > 0*) : 


Au=f (ath, b+k) —f (a, 6) =H(Al?-+2Bhk + Ck) +0(6%). 


— 
If we denote by « the angle made by the vector PQ (the “displace- 
ment” of the point P) and the positive direction of the OX-axis, then 


evidently 


h=gcosa¢, k=opsing, 





%) Terms of the first order with respect to k and & vanish, since the point 
P (a, 6) is a stationary point. 
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and consequently 
Au=f (ath, b+k)—f (a, 6)= 
=4p?(A cos? a+2B cos « sin «+Csin® «)+0(p?). 


Using this expression for the increment Aw we can readily see 
that the nature of the given stationary point P(a, 6) depends on the 
behaviour of the quantity 


? (a) = A cos? « + 2B cos asin « + C'sin? « 


which is a function of the ‘‘angle of displacement” and varies from 
0 to 2x. Let, for example, 9 («) > 0(0 < « < 27). Since the func- 
tion ? (a) is a continuous function of «, it assumes a smallest value 
in the interval (0, 2x), which, according to our assumption, is posi- 
tive; it follows from the expression obtained for Au that we have 
for ep > 0 


Au =p? 406 (a) + 0(1)}, 


and since 9 (x) > u (O <a < 2z), therefore for a sufficiently small 
Pp we have Au > 0 irrespective of «; but this implies that the func- 
tion u = f(x, y) has a minimum at the point (a, 6). We can similarly 
show that the function f (x, y) has a maximum at the point (a, b) for 
e (a) << 0(0 <a <¢ 2r). Finally, if » («) assumes both positive and 
megative values in the interval (0, 2m), then let » (a) > 0 and 
@ (a) <0. Assuming that P tends to zero while « remains constant, 
we shall evidently have Au > 0 for a small P when « = a and 
Au <0 when « =a. This shows that the function / (x, y) has 
neither a maximum nor a minimum at the point (a, 6). Hence the 
sign of the quantity 9 (x) for 0 <a < 2m is, in fact, decisive in 
determining the character of the given stationary point. 


Hence the sign of such a “square trinomial’’, z.e. the sign of the 


“discriminant” A = AC — B?, is of decisive importance. We must 
therefore consider three cases. 


l A=AC— B>0. We have identically 
Ao(a) = (A cosa + Bsin «)? + A sin® a. (1) 
Since in this case A + 0, the first term on the right-hand side 
vanishes only for cot « = — B/ A, and the second only for sin « = 0; 


since these two conditions are incompatible, the angle « has no cotan- 
gent for sin « = 0), therefore Ao (a) > 0 for every x, IfA > 0, 
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then 9 («) > 0 and the function u has a local minimum at the point 
P; in contrast if A <0, we have ? (a) <0 and Pisa local maximum 
of the function u. Hence if A > 0, the point P always gives a local 
extremum whose nature is determined by the sign of A. 


2, A= AC— B? <0. Let us at first assume that here also 
A +#~ 0. The relation (1) shows that (the first term on the right-hand 
side is positive and the second equal to zero) we have 4 9 (a) > 0 
for « = 0; on the other hand if 


cot % = — ; 


ba | by 


we have A ¢ (a) < 0 (the first term is equal to zero and the second 
term negative); hence ¢ (a) has different signs for different values of 
« and the function u cannot have a local extremum at the point P. 


What result do we obtain for A = 9? In this case 
? (a) =2B cosa sin a+C sin? a=sin « (2B cos x+Csin x), (2) 


where B ¥ 0, for otherwise we should have A = 0. If @ is a sufhi- 
ciently small positive angle, then evidently 


| C| sina < 2] BI cos «, 


so that the sign of the brackzt (2B cos a + C sin «) coincides with 
the sign of the first term which changes as «is replaced by — «; 
and since sin « changes its sign during that change, the relation (2) 
shows that ‘e (a) and 9( — a) have opposite signs and the function u 
cannot have a local extremum at the point P. Hence if A < 0, 
there is no local extremum at the point P. 


3. A = AC— B*=0. In this case the analysis of terms of 
the second order in Taylor’s formula does not give final results. If 
the function u has partial derivatives of the third order at the point 
P, other terms must be analysed in Taylor’s formula. However, we 
shall not consider these problems here. 


Example. The function 
= x7 — xy + yy? — Ae + y 


has a single stationary point x = 1, y = Oas can be seen by solving 
the system of equations 
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In this case 

. ao. BS, ceo 
and therefore A = AC — B? = 3. Since A > 0, therefore z has a 
single extremum, i.e. a minimum at the point (1, 0). 


For further exercises to § 96 cf. Problem Book by B.P. Demi- 
dovich, Section VI, Nos. 425, 429, 430, 435, 487, 438. 


CHAPTER XXIII 


SOME SIMPLE GEOMETRICAL APPLICATIONS 
OF DIFFERENTIAL CALCULUS 


§ 97. Equations of tangent and normal to a plane curve 


The geometrical illustration of a derivative as the angular 
coefficient of the tangent to a given curve at a given point enables us 
to use the methods of differentials calculus in 
order to solve numerous geometrical problems. 
Let us assume that we want to draw the tan- 
gent toa curve which is the graph of the differ- 
entiable function y = f(x) at a point with 
abscissa a (fig. 55). We know from analytical 
geometry that the equation of a line which 
passes through a point with coordinates (a,b) 
can be written in the form: 





y—b=k (x — a), 


where & is the angular coefficient of the straight line. In our case 
b = f(a), k =f’ (a); hence the equation of the tangent to the curve 
y =f (x) at the point with abscissa a has the form: 


y —S (a) =f" (a) (* — a). 


A straight line perpendicular to the tangent at the point of 
contact is known as normal to the given curve at the given point; 
since the angular coefficients k and k’ of two mutually perpendicular 
lines are connected by the relation kk’ =- — 1, the angular coefficient 
of normai to the curve y = / (x) at the point with abscissa a is equal 
to — 1//' (a) (provided f’(a) # 0). Hence the equation to this 
normal can be written in the form 


1 
I — f (a) = Soft bay. (x aa a); 
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or 
x—at+fi(a) Ly —f(a)]=0. 


It is well-known from analytical geometry that it is often more 
convenient to express the curve in “‘parametric’”’ form, 7.e. by means 
of the following two equations: 


x=o(t), y= (t), 


where each value of the “parameter” ¢ in an interval corresponds to 
a definite point (x, y) on the given curve. We know that the angular 
coefficient of the tangent to the curve at this point is equal to 


we also know (§ 33) that this expression of the derivative in terms 
of differentials remains valid when x (and therefore also y) become 
functions of a new arbitrary variable ¢ as they do in this case. Taking 
t for the new independent variable we have: 


dy 


but dx] dt = 9 (t), dy | dt = ’ (t) and therefore 


ra VM), 

2 (t) ’ 
if we want to write the equation of the tangent to the given curve at 
a point which corresponds to a value ¢ of the parameter, we must 
take into consideration the fact that the coordinates of this point are 
equal tox = 9 (t), y=y (t) and the angular coefficient of the tangent 


is equal to y’ = ¥’ (t) / 9" (t); hence the equation of the tangent is as 
follows : 


pa Oe. 
, v (t) og! (ay | ? (t)], 


or 


x—?(t)_ y—¥ (4) 
On a (ft)? 


which owing to its symmetry is very convenient ; since the angular 
coefficient of the normal is in this case equal to 
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Bee: 2) 


_— = —_— 


J Y(t)? 


therefore the equation of the normal is as follows : 








y- 9 = =F bo) 


or 
e (ix -—e +4) ly -b@] =0. (2) 
Ifthe curve is given in terms of polar coordinates 
r=f (6) 


and we wish to write the equation of the tangent at the point with 
coordinates 9, 77) = f (8), we can solve this problem in the same 
way as the previous one remembering that cartesian and polar coor- 
dinates are connected by the relation. 


x=rcos@, y=rsin g 
and for points on the given curve it takes the form 
x =f (9) cos 8, y = (6) sin 8. (3) 
Equation (3) represents the given curve in parametric form, where 
the polar angle @ is a parameter ; we have : 
, . dy , . 
4~== f’ (6) cos 9 — f(6) sin @, 46 = f'(9) sin @ + f (6) cos @. 
According to (1) the equation of the tangent at the point 
6 = 8, can be written in cartesian coordinates in the following form: 


I— F (9) sin 9% 7 x — f (9%) cos 
S' (0) sin 89 +f (@) cos @) ~~’ (80) COS O — f (4%) sin 





and in polar coordinates in the form 


rsin @ — f (@9) sin 6 = r cos 9 — f (89) cos O95 _ 
FS’ (80) sin 69 +4 (80) cos 69 St’ (80) cosG5 —f (Go) sin®g ™ 





or, assuming that / (@5) = ro, f’ (@9) = 7’ in the form 


rsin @ — ro Sin Oy _ 7 COS § — 7q COS Hy 
r’y Sin 89 +7, COS Oo ry COS Oy — 7p SiN Oo 





For exercises to.§ 97 cf. Problem Book by B.P. Demidovich,. 
Section II, Nos. 119—121, 124, 126, 141, 142. 
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§ 98. Tangential line and normal plane to a curve in space 


The geometrical definition of a tangent to a curve in space 
does not differ from its definition relating to plane curves. If we 
wish to draw a tangent to the given curve at a given point M, we 
take another point JV on the curve close to M and draw a straight 
line (chord) through these two points; if, when the point VV comes 
indefinitely close to the point , the drawn chord tends to a definite 
limiting position, then this limiting straight line is a tangent to the 
given curve at the point M. Assuming that the curve in space is 
given by parametric equations of the form 


x=o(t) y=ov(), z=7 (A) 


we must try to find the equation of the tangent to this curve at a 
point corresponding to the given value of ¢, of the parameter ¢ (2.e. 
at a point with coordinates xy = ? (to), 99 = (to), Z9 =X (to)). 
Let the parameter ¢ receive an increment A? and let us go from the 
given point to the point 


Xgt AX=Pltgt At), Pop AI=HY (Lot At), StAZ=Z (tot At). 


The straight line (chord) which connects the two points (the 
given and the displaced point) can, in accordance with the laws of 
analytical geometry, be expressed by the following equations : 


RF Rs D0 eG 
Ax Ay Az? 





or by an equivalent system. 


Be Ne Oi OEY 
cial AY Az (1) 
Af At Al 





If we assume that AZ tends to zero and the functions 9 (t), 
) (¢) and y(¢) have nonzero derivatives at t = t), which we shall 
respectively denote by x’, yo, 29, then the system of equations (1) 
for the drawn chord has the following form in the limit : 





x — 9g J —D2o x — XQ 
ey? pe 7 2 
«9 Jo eae? (2) 


or, which is the same, 


* = 9 x — (to) _ 
9" (to) args mee (3) 
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The system of equations (2) or (3) is analogous to equation (1) 
§ 97 and evidently provides the analytical expression for the tangent 
to a curve in space. 


Denoting by «, @ and Y the angles made by the tangent to the 
given curve at the point (x9, yo, Z9) with the positive direction of the 
axes of coordinates, we have in accordance with the laws of analytical 
geometry : 


cos % = ner: FAfo) ah rar. cosp = i712 val ai 2.4)? 
V9 (to) AY (to) +7? (to) V 9" (to) + Y*(lo) +X to) 

se a MO Sy 
VP? to) +h (to) + ZX to) 














cos Y = 





(t0) 


In particular, if the given curve is expressed by the following equa- 
tions : 


J = p(x), z= Z(x), (4) 
the equations of the tangent at the point (x9, 9, Z9) have the form: 


JTI0_ %— %o 




















a ae Jy’ (Xo) ee! Ga 
and we have: ‘ 
l y (x 0) 
= 4 i a cr eae Cs > cos based Py a hee Nae Oey 9 
OSE TUE H Gay neta) | TEE a 
Z (xq) 
cos Y= ———— . 
J 1+ y’® (xg) +2'?(x9) 


In all cases the choice of the sign in front of the radical depends on 
the choice of one or other direction of the tangent. 


A plane drawn through a point of a curve in space perpendi- 
cularly to the tangent at that point is known as the normal plane to 
-the given curve at the given point. Normal planes are very impor- 
tant in the theory of curves in space and play a similar role as normal 
lines (i.e. ordinary normals) in relation to plane curves. In accord- 
ance with the general laws of analytical geometry we can, by 
knowing the equations of the tangent in the forms (2) or (3), write 
directly the equation of a normal plane to the same curve at the 
same point in the following form : 


x" g(x — Xo) +9 o(¥ — Po) + z'o(z — Zo) = O, 
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or 
@' (to)[x—9(to)] +4’ (fo) 9-4 (lo) +2 Coe —% 0) ]=9. 
We can see that these equations are analogous to the equation 


(2) § 97 of a normal to a plane curve. 


If the curve is expressed by equations of the form (4), the 
equation of the normal plane at the point (%, 9, 2) has the form: 


x— Hq Hy" (x) 9 — 0) +2’ (%0)(Z—Zq) =. 


For exercises to § 98 cf. Problem Book by B. P. Demidovich,. 
Section VI, Nos. 341, 342, 344, 346. 


§ 99, Tangential and normal planes to a surface 


Let us consider a surface in space which is expressed by the 
following equation : 


F(x, 9, z)=0 (1): 


and choose an arbitrary point M with coordinates xg, 9, 2, On it so: 
that F'(x9, Yo, 2) == 0. Let us draw an arbitrary curve on the surface: 
(1) which passes through the point M; let this curve have the follow- 
ing parametric equations: 


x=9(t), y=(t), z= x(Z) (2): 
Since the curve (2) lies wholly on the surface (1), we must have: 
identically (z.e. for every arbitrary value of the parameter ¢ in some: 
region) 


Fle (4), b), x(4)] = 0. (3) 


On the other hand, since the curve passes through the point M(x, 9, 2)>- 
therefore for a given value f) of the parameter ¢ we have: 


Xo = P(to), Yo = ¥ (Eo), Zo = x (to). 

In order to draw further conclusions we must now assume that 
the function F(x, ,z) is differentiable at the point M (x9, v9, Zo)- 
In chapter 22 we have agreed to call the function u =f (x,y, z): 
differentiable at the point (x, y, z) if, assuming that 


Att = f (x “PA ms eee Ad, Z + AZ) SSF (MDs Z)s 


of af of 
Grae uae ri Ayt a7 Aa 





p= VAP TAPE AZ, 
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we have forp > 0: 
= du + 0(p). 


The law for differentiating composite functions holds for differentiable 
functions (§ 92) : if the function u = f(x, y, z) is differentiable and 
x,y, Z, are also differentiable functions of a new variable ¢, then 


du ou dx ou dy ou dz 


Ge > oade ay at Oe ae (4) 


We have already agreed to assume in our case that the function 
F(x, y, Z) is differentiable at the point (x9, yo, Zo) which corresponds 
to the value ¢) of the parameter ¢. If we express x, y, Z in terms of £ 
by means of the relation (2), then F(x, y, z) becomes a function of 
the parameter ¢ and, according to (3), it is a constant. Hence 
dF / dt = O and it follows from formula (4) that 


oF dx | OF dy | OF dz 
ax dt | Oy dt T 3 dt ae (5) 
Having made this remark we can now write the equation of the 
tangent to the curve (2) at the point M (xo, 7, Zo) to correspond to 
the value ¢, of the parameter 4 According to formula (2) § 98 these 
equations can be written in the form 


RS PY a a as > Ao 
x9 yo Z'0 





Hence for every point (x,y, z) on our tangent these three relations 
have the same value which we shall conveniently denote by 1/A 
(where A is clearly different for different points on the tangent). 
But in that case 


x9 = Mx — Xo), Do = ALY —Do)s 20 = AZ — Zo)- (6) 


On the other hand, the identity (5) gives us for £ = fo, if we denote 
respectively by A, B and C the values oF / ax, oF / oF and CF / ez at 
the point M(x, Yo: Zo): 


Ax’, + By’ + Cz "5 = 0. 


Substituting in this relation x’, y‘) and z’ by their cxpressions 
from (6) and cancelling A we obtain: 


A(x — xo) + Bly — 90) + Cle — Zo) = 9~ (7) 


450 A COURSE OF MATHEMATICAL ANALYSIS 


Let us note that in this case x, », z are coordinates of any 
point on the tangent to the curve (2) at the point Mand 4, B and C 
are values of the partial derivatives of the function F at the point M. 
If we regard x, y, zin the equation (7) as current coordinates, then 
the latter equation represents a plane which passes through the point 
M;; it depends on the form of the surface (1) but is quite indepen- 
dent of the curve (2) drawn on this surface. The fact that the coordi- 
nates of every point on the tangent to the curve (2) are connected 
by the equation (7) show, that this tangent lies wholly in the plane 
(7). But the curve (2) isan arbitrary curve drawn on the surface (1) 
through the point Mf. We can draw an infinite number of such 
curves; we thus see that the tangents to all those curves lie in the 
same plane (7); this plane which is a sort of ‘‘carrier”’ (a geometrical 
set of points! of tangents to arbitrary curves drawn on the surface (1) 
through the point M is known as the tangential plane to the given 
surface at the point M. The equation (7) of tangential plane can be 
written in a more expressive form if instead of the neutral notation 
A, B, C for the partial derivatives of the function # at the point Af 
we write respectively 


er er oF 
ae 09°? 825° 





where the index 0 shows that all three derivatives are taken at the 
point x = xo, ) = 9, Z = Zg- The equation of the tangential plane 
thus becomes: 


er 


eri 
229 0) 


EB 1) + B04 

The straight line drawn through the point M perpendicular 

to the tangential plane is said to be normal to the surface at the point 

M. According to the laws of analytical geometry the equations of 

this straight line (when none of the three partial derivatives 
vanishes) can be written in the following form: 


K—%o YM  F— Zo 
a Ee = oR 
CX y CPo 0 Zy 











In particular, if the surface is expressed by the equation: 


z= f(x 9), (8) 
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we have F (x, y, z) = z — f(x,y) and the equation of the tangential 
plane becomes 


ee ee ee ee 4 
co 0 of af 
GX 9 020 


If we denote respectively by «, B and Y the angles between the 
normal to the surface (8) at the point (x9, yo, Zo) and the positive 
direction of the axes of coordinates, then, as we know from analytical 
geometry, we have 














Oy 
he 
cos % = = 59 
tal + Gs) +(%) 
Gy: 
cosB = —-- Oo. 


aafie COG) 


cos ¥Y = 8 === 
TE f 
ea/i+ (2£)4 (25) 
The choice of the sign in front of the radical depends on our choice 


of direction for the normal under consideration; it is self-evident 
that this sign must be the same in all three formulae. 





For exercises to $99 ef Problem Book by B.P. Demidovich, 
Section VI, Nos. 351, 352, 360-362. 


§ 100. Direction of convexity and concavity of a curve 


We shall now return to the theory of plane curves and deal 
with another problem, viz. the direction of convexity and concavity. 
ofacurve. Let us assume that the function » = f(x) has derivatives 
cof first two orders at x = a. The equation of the tangent at the 


point a to the curve y = f(x) has the form 


vHfla +f (D@ — 4). 
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At the point a + A, close to a, the ordinate of the tangent will 
therefore be 


dtan= f(a) + hf (@) 
whereas the ordinate of the curve at that point is equal to 


Jeurte= St (a + h); 


in order to find out which of these lines lies above the other in the 
immediate neighbourhood of the point a we construct the difference 


Jeurve— Jtan= F(a + h) — f(a) oa hf’ (a), 


‘and since, according to our assumption, f” (a) exists, it follows from 
Taylor’s formula that we can represent the right-hand side of this 
equation in the form 


aa 
ff" (a) + 0 (#4), 
and we obtain: 
ar ‘ 
Jeurve— Jtan = re? (a) + 0 (h*). 


Let us assume that f” (a2) # 0; in that case the second term on the 
right-hand side is infinitely small as compared to the first term for 
h — 0; the sign of the right-hand side (and therefore also of the 
left-hand side) coincides with the sign of the first term when |A| is. 
infinitely small, ze. with the sign off” (a). If f"(a) >0, then 
Yeurve>Jtan at all points sufficiently close to a, i.e. the curve lies. 
above its tangent (fig. 56, a); the position of the two is reversed for 


f" (a) <0 (fig. 56, 6). 


In ;the first case it is said that the curve y = f(x) has a con- 
vexity from below at the point a (in the direction of negative y) or 
a concavity from above (in the direction of positive y); in the second 
case the position is reversed— the curve is convex from above and 
concave from below at the point a. The use of this terminology is. 
-at once apparent by looking at figs. 56 a and 6. We thus see that 
the sign of the second derivative determines the direction of 
convexity and concavity of a curve in the same way as the sign of 
the first derivative tells us whether the function increases or 
decreases. 
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Conversely, we know that the curve y = f(x) is convex 
from below in the neighbourhood of the point -a (i.e. it hes above 
its tangent). If /”(a) exists, then it, 
follows from above that it cannot 
be negative, for in that case the rela- 
tive positions of the tangent and curve 
would be reversed. Therefore f” (a)>0. 
‘The case when f” (a) = 0 is quite possible 
as can be seen on the example of the curve 
y=x* at x=0; similar arguments 
clearly show that when curve is convex 
from above at the point a, we should have 
Jf” (a) <Oand here again the value f” (a) 
=0 is possible. Finally, in the neighbour- 
hood of the point a the curve may lie 
above its tangent to one side of a and 
below it to the other side of a; this is the 
position with the function y = x? in the 
neighbourhood of the point x = 0, which 
we have already considered on several 
occasions (fig. 21 §40); the curve intersects 
its tangent at such a point and changes Fig. 56. 
the direction of its convexity in the process. 

Points of this type are usually known as inflexions of the given 
curve. It is evident that the derivative of second order f” (a), 
in case it exists, should be equal to zero at a point of inflexion. 





Hence if f” (2) = 0, we cannot draw any conclusions as to 
the direction of convexity of the curve in the neighbourhood of the 
point a; we may in this case have a convexity from above; a 
convexity from below ora point of inflexion ; even more complicated 
cases are possible. For further analysis it is necessary to investigate 
successive terms in Taylor’s series in the same way as we have done 
while finding extrema of functions (§41). However, we shall not 
go into further details here. ' 


For exercises to) § 100¢ f Problem Book by B. P. Demidovich, 
Section II, Nos. 348, 349, 352-354, 362. 


§ 101. Curvature of « plane curve 


It is obvious that different curves can have different curvatures 
in different intervals. The curve shown in fig. 57 has an almost recti- 
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linear left side and there its curvature is naught. A circle has the 
same degree of curvature throughout. Ifwe imagine several circles. 
of different radii having a common tangent at a point (fig. 58), then 
we can sec clearly that the degree of curvature is greater, the 
smaller the radius of the circle is. A large curvature of a path (bend) 
can be experienced without seeing it (without looking out of the 
window) while travelling by car or rail. The importance cf this type 
of curvature prompts us to evaluate it scientifically; we must learn 
to compare not only the qualitative curvatures of various curves (one 
curve has, say, a greater curvature than the other) but we must learn 


1 dy 


to give it a quantitative evaluation, 7.e. we must learn to measure the 
degree of curvature of curves. In the science of road construction 
(any kind of road or rail) this exact approach is essential] and this 
problem is also important in physics and thermodynamics; we cannot 
merely say that one body is hotter or cooler than another body, but 
we must Icarn to express quantitatively the heat of various bodies 
(t.e. their temperature). 


In our visual representation the degree of curvature of a curve 
is closely related to the rate at which it changes its direction. Thus. 
the curve shown in fig. 57 hardly changes its direction in the interval 
(a, 6) — the tangents at different points (and in particular at points with 
abscissae a and 5) are almost parallel to one another; therefore this. 
curve appears to have a small curvature in the interval (a, 5); in 
contrast, this curve appears to have a large curvature in the interval 
(6, c), for its direction changes considerably in that interval; thus. 
the tangents drawn at the ends of this interval have very different 
directions. It is therefore clear that in order to measure the degree 
of curvature of a curve in an interval quantitatively we must take for 
thc basic value the angle by which the tangent to the given curve 
rotates in passing through this interval, z.e. the angle between the 
tangents at the beginning and end of the given interval. However, 
if only one angle is given, we cannot determine the degree of curva- 
ture of the curve in the given interval. In faci, if you are told that,, 
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say, the railway line has a bend of 30° at a certain spot, this will tell- 
nothing about the curvature of this path. You will undoubtedly ask 
how long this section is in which this bend takes place. If, for 
example, the path has turned by 30° over a distance of 2 km, then 
the curvature is very insignificant; if, however, the path has bent to 
the same extent over a distance af 100 m, then this curvature is 
large. ‘Thus in order to evaluate the degrec of curvature of the path 
in a given interval it is necessary to know not only the angle g which 
measures the change in direction of the curve in the given interval 
but also the length s of this interval. In this case the natural mea- 
sure of the degree of curvature of the curve in the given interval will 
evidently be given by the ratio © / s, ¢.e. by the change in direction per 
unit length of path. This quantity is known as average curvature of the 
curve in the given interval. The meaning of this term is self-evident: 
it is obvious that a curve can have different curvatures in different 
parts of a given interval and the concept of average curvature does 
not take all these- differences into account; it merely shows the 
average change in direction of the curve per unit length of its path. 


If now we want to consider not the average but local character- 
istic of the degree of curvature in the immediate neighbourhood of 
a certain point A on the curve, we must again use the same argu- 
ments as in § 26 when we were considering the instantaneous (local) 
velocity of motion at a given instant on the basis of the average 
velocity of a body in a given time interval. Let us take another 
point B on our curve apart from the point .4; let the length of the 
arc AB of the given curve be equal to s and the angle between the 
tangents to the curve at the points A and B be equal to ¢ so that the 
average curvature of the arc AB is equal to ¥/s. If the point B lies 
close to A (i.e. if s is small), we have reason to believe that the degree 
of curvature of the curve will not change too much in transition from 
A to B and that therefore the average curvature 9 / s of the arc AB 
will still give us a sufficiently accurate description of the degree of 
curvature of the curve in the immediate neighbourhood of the point 
A; this characteristic will be the more accurate the smaller s is, z.e. 
the smaller the distance from the point B to the point A is. There- 
fore if, as B — A (or, which is the same, as s > 0) the average cur- 
vature ? /s tends to a limit K, then we can naturally regard this 
limit as the (local) curvature of our curve at the point A (or in the imme- 
diate neighbourhood of the point A). 


Hence curvature of the given curve at the given point A is expressed by 
the limit of the ratio of the angle between the tangents of the curve at the points 
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A and B to the length of the are AB provided the point B lies on the given 
curve and approaches indefinitely close to the point A. 


Having established the geometrical meaning of the concept of 
(local) curvature we will now show how the methods of differential 
calculus enable us to evaluate the curvature of a given curve at any 
point. Let the function.y = f(x) which is represented graphically 
by the given curve have derivatives of the first two orders at the 
point x. Let us consider a point B (x + Ax, y + Ay) on the given 





Fig. 59. Fig. 60. 


curve other than the point A (x, y) (fig. 59). If we denote the angles 
made by the tangents to the curve at these two points and _ the posi- 
tive direction of the OX-axis by « and @ respectively, then evidently 


tana = f’ (x), tanB = f’ (x + Ax). 


The angle between these two tangents is equal to ? =|« — B| = 
| arctan f’ (x + Ax) — arctan f’ (x)|, as can‘be seen from fig. 60. 
On the other hand, if we denote the length of the arc of the given 
curve in the interval (a, x) by s (x), where a is a constant, then the 
length s of the section AB of the given curve is equal to 


s=s(x+ Ax) —s (x). 


We thus obtain the following expression for the average curvature of 
the arc AB of the given curve : 


@ _|arctan f' (x + Ax) — arctan f’ (x) | 
5 s(x+ Ax) —s5 (x) 





or, dividing the numerator and the denominator by Ax 


Iarecan f’ (x + A x) — arctan f’ (x)] 
P Ax 
so s(x + A x) — 5 (x) 
7 Ax 
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If we now assume that A x tends to zero, then it follows from our 
assumption of existence of y” = f” (x) that the numerator will tend to 





fareny = |y"| 
| we 


‘whereas, according to § 52, the denominator will have a positive 
limit 





ds 
ree Ae a ae ee 


‘We thus obtain the following expression for the curvature of the given 
curve at the point 4 (x, y): : 





K = lim <= <a Ps — (1) 


and our problem is solved. 


If the curve is given by a parametric equation 


x= o (2), y= (t), 











then 
,.o _V@ 
dx o' (t)’ 
y(t) 
; aay () ce 1 a oO 
ep’ (t) [?" (é)]}° : 
3 


and after elementary calculations we obtain from formula (1) : 
OY O-¥ Or Ol is 
[?’ (¢) + y? (yy? 





A straight line is expressed by a linear equation y = mx 4+ 7; 
therefore y” = O at every point and it follows from (1) that K = 0; 
hence the curvature of a straight line is equal to zero. In the case of a 
circle of radius r it is more convenient to use the parametric formula 


x=rcost, y=rsint; 


after elementary calculations we obtain from formula (2) K = I/r: 
hence the curvature of a circle is the same at every point and is equal to the 
reciprocal value of its radius. 
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§ 102. Tangential circle 


Let the cirve » =f (x) have a nonzero curvature K at the point 
A (x, ») (y" #4 0). Let us draw a normal to the curve at the point 4 
(fig. 61) and mark on it an interval AC of length 1/F in the direction 
of the concavity of the curve. Ifwe now draw a circle with centre 
at C and radius r = 1/K, then this circle will pass through the point 
A and have a common tangent with the curve at that point ; since 
the radius CA lies on the normal to the curve ; moreover, the con- 
vexities of the curve y = f (x) and of our curve are in the same direc 
tion at that point ; also the curvature of these curves at the point A 
is the same, since the curvature of our circle is equal to I/r= K. We 
can therefore say that among all circleswhich can be drawn through 
the point A our circle comes closest of all to the direction of the circle 
at the point A having a common direction with it (tangent) and the 
same curvature ; its convexity is also directed to the same. 


This circle is known as the circle of curvature of the given curve 
at the point A. Its radius 


3 
1 _(1+y")* 
K |v" | 





is known as the radius of curvature and its centre as the centre of curva- 

ture of the curve y = f (x) at the point A. In the same way asa 

tangent can be used instead of a 

curve in all instances where only 

the direction of the curve is invol- 

ved, so the circle of curvature can 

replace the given curve in all prob- 

lems where apart from the direction 

PER of the curve its curvature and direc- 

¥ | Alt, y) tion of convexity are also involved. 

| x This is the main part played by the 

Fig, 61. circle of curvature in many geome- 

trical investigations which involve 

the given curve. It thus becomes obvious why the circle of curvature 

is called a tangential (or, as it is often said, a contiguous) circle to the 
given curve at the point A. 


yA 





Let us now find an analytical expression for the coordinates 
(a, b) of the centre of curvature. In the case shown in fig. 61 | »”|= 
y > 0,9 > Ox% > ay<b. The differences x —a and b—y 
are the projections of the interval rin the directions OX and OY res- 
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pectively. Therefore if we denote the angle between the tangent at 
the point A and the positive direction of the OX-axis by ? (so that 
tan 9 = y’), then 











19,4 td eat 19 
eee em nee ), sa ee: uaa 4 
y Vi + yy? Jy 
2)? 2 
b — y=r ee" aw ) o —_ ne ee 
y Vi + y? J 
hence 





It can be readily shown that these formulae remain valid if the 
course of the curve y = f (x) in the neighbourhood of the point 4 is 
different. 


The concept of a tangential circle can also be approached from 
another point of view which shows even more clearly its analogy with 
a tangent. We have defined a tangent as the limiting position of the 
chord joining the given point A (x, y) and another point B (x + Ax, 
y + Ay) on the same curve when A «x (and therefore also A _y) tends 
to zero. If, however, we want to draw through these two points not 
a straight line but a circle, we encounter difficulties since an infinite 
number of such circles can be drawn : we know that in order to define 
a circle uniquely we must be given not two but three points (not 
lying on the same straight line) through which the circle is to be 
drawn. ‘Therefore, apart from the point A we shall take two more 
points B, and B, on our curve with abscissae x, and x,. Theequation 
of the circle drawn through the points A, B, and B, can be written 
in the form 


(x — «)? + (y — 2)? = Pp’, 


where the radius 9 and the coordinates « and £ of the centre of the 
circle are determined from the condition that the circle given by this 
equation must pass through the points A, Bj and Bz. If we assume 


that 
(x — «)? + [f (x) — BP — 9? = F (wx), 
then this condition can evidently be written in the form 


F(x) =0, Fy) =0,  F (x) = 0. (1) 
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These three equations enable us to determine the unknowns a, f and 
e. However, we shall use another method. Let us assume that 
x <x, <x. It then follows from (1) that we can apply Rolle’s 
theorem to each of the intervals (x, x1) and (x1, x.). This gives us : 


F'(&)) = F" (&) = 0; 


‘where x < & < x, < & < x,; therefore, applying Rolle’s theorem 
to the function F’ («) in the interval (&,, &) we obtain: 


F” (€) = 0, 
where € lies between £, and &. 


Let us now assume that the points B, and B, approach indefi- 
nitely close to the point A along the given curve, 7.¢. we assume that 
xy —> x and x,—> x; it is then evident that the points &,, € and & will 
tend to x. Our circle drawn through the points A, B, and B, will in 
this process continuously change its radius and its direction; for every 
position of the points B, and B, we can find from the equation (1) 
the elements «, 8 and 0 for this circle; we could perform these cal- 
culations and find the limits to which «, 8 and p tend as x, > x and 


x,-> x. However, it is simpler to act otherwise. Since we have for 
the arbitrary x, and x, 


F(x) = 0, F’ (&) = 0, F" () = 0 


and since — —> x as £, -> x, therefore we should have for a limiting 
circle *) 


F (x) = F’ (x) = F" (x) = 0, 


ie. denoting the elements of the limiting circle by a, ) and 7 and 
assuming that f(x) = » 


F (x) = (x —a)? + (y — bP? — 7? =0, 

Gye tes lly Say SO. 

F’ (x) = 2 + 29? + 2(y — Bb) 9" =0. 
The last of these equations gives us directly : 


12 
eae ane as 


J 








*) In this case we assume continuity of F’’(x) at the point x1; for this to be 
t that f’’(x) should be continuous at that point. 
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after which we obtain from the last but one equation : 





finally after substituting in the first of the above equations the values. 
of b — y and a — x we obtain: 








The formulae obtained above show that the required limiting 
circle does, in fact, coincide with the circle of curvature of the given. 
curve at the point A. 


Thus the circle of curvature (or the tangential circle) of the given curve 
at the point A is the limiting position of the circle which passes through the 
point A and through two other points which lie infinitely close to the given 
point on the given curve. 


For exercises to §§ 101—102 ¢f. Problem Book by B.P. Demido- 
vich, Section II, Nos. 566, 567, 571, 572, 575, 576, 577. 


CHAPTER XXIV 
IMPLICIT FUNCTIONS 


§ 103. The simplest problem 


We have already met implicit functions in § 92 and we shall 
now consider the problem solved there. We worked on the assump- 
tion that »y = f(x) identically satisfies the following equation in an 
interval (a, 5) 


F (x, y) = 0, (1) 
Le. we had 
F [x, f (x)] = 0 (a<uv<b). 


Having assumed that the function f (x) is differentiable in the inter- 
val (a, b) we tried to express its derivative in terms of the partial deri- 
vatives of the function & with respect to . and y and found the follow- 
ing expression for this derivative : 


v=f'(x) = — m. 


However, in concrete cases the problem is usually somewhat 
different. Only the function F (x, y) is given ; as for as the function 
yo=f (x) which satisfies the equation (1) in an interval is concerned, 
neither its continuity and differentiability nor even its existence is 
assumed beforehand ; on the contrary the determination of the con- 
ditions for existencc of such a function and study of its properties is 
the main purpose of our problem. Among the numerous methods 
used for the determination of new non-elementary functions this 
“implicit” description of functions by equations plays a very im- 
portant part. ‘The set of laws which characterise this method of 
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‘describing functions comprises the theory of implicit functions whose 
elements we shall study in this chapter. 


The above problem can be stated ina much wider sense. In 
stead of the function F (x, y) of two variables we may be given a 
function F (x, y, Z, .--, u, v) of any number of variables and we may 
have to determine from the equation 


F(x, Dy 25 say Uy 2) = 0 


-any one of these variables, for example 2, as a function of the remain- 
ing variables x, y, Z, ---, wu; this means that existence of a function o. 
the variables x, y, Z, ..., u, is required, 2.¢. 

Sf RED es ahs 


which would identically satisfy the equation 


F [x,9, Ay very u, f (x, I, Zp tees u)] = 0, 
in some region of values of these variables; we are also interested in 


the properties of this function in case it exists. 


The general theory cf implicit functions can deal with an 
even wider problem when not one but several detcrmining equations 
are given: 


ene (2) 


whose left-hand sides depend on 7 variables, where n>m. We 
wish to “‘solve”’ this system of equations with respect to some m out 
of x; variables, for example, with respect to x;, x9,-.-, Xm. This implies 
as follows: we must establish the conditions under which m functions 


oY 
V1 =fi (rai Memes. xa Ie 


x =f» (Xmt1 Xm+29 e009 Wn)4 


Am = Sm (Xm+15 Nm+2. +09 an ) 


cof the variables Xm41> Xm+2) ++» Xn exist which identically satisfy the 
system of equations (2) in some region of values of these variables 
so that for every %n+1y Yinter +++» Xn in this region 


fy Ltt (Xmep - » Xn)» sre aa (nts eet ad Mins Mieka 8s Eva =0 
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(k =1, 2, ..., m); if these functions f, exist, we must study their 
properties (continuity, differentiability, etc). 


In future we shall understand by the simplest problem a problem. 
where only one determining equation is given (regardless of the 
number of variables) and by the general problem —a problem where 
several determining equations are given. In this paragraph we 
shall only study the simplest problem. We shall see thatthe method. 
of investigation does not depend on the number of variables;. 
therefore in order to prevent.our notation from becoming too 
complicated we shall consider the simplest case involving two. 
variables, although all arguments used will remain valid for any 
number of variables. 


“Thus we shall assume that we are given the equation 
F(x, 9) = 90 (3) 


and try to find the function y = f(«) which identically satisfies this 
equation in very region of values of «. It is clear at once that. 
existence of this function as well 
as its properties depend on the: 
properties of the given function 
F(x, y). The more assumptions. 
we make with regard to the 
function F, the more definite 
statements we can make with 
regard to the function f(x). 
Hence our problem can have 
Fig. 62 several variations ; here we shall 
only consider one variation, 2.e. 
a variation which crops up most often in applications of the theory of 
implicit functions. 





Theorem 1. Let the function F (x, y) be continuous and have conti- 
nuous partial derivatives with respect to both variables in a rectangle 
R (xo ~@a QU xg t+ 4,79 — by <Q + 6). 


Let. F (x 9590) = 0, F'y (x05 ¥ 0) # 0. 


Then there exists a unique function y = f(x) which is continuous and satisfies 
the equation (3) in some interval A (x9 —- a<x<xqg + 4)3 it is equal 
to yo for x =X. This function has a continuous derivative in the 
antersal A. 
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Proof. 1°. Definition of the function f (x). 


Let us assume that F’y (9, 99)>0. According to the lemma 
§ 23 (which holds for all continuous functions irrespective of the 
number of variables) we should have F’, (x, y)>0 also for all points 
of a rectangle R’ (x9 — *< x<xyq + % Vo — BX IK y_ + B) (fig. 
62). It is important to remember that the numbers « and 8 can be 
arbitrarily small; hence we are already in a position to assume that 
R’ lies entirely within R. We therefore have: 


F', (x9 _y)>0 (yo — BSY Spo + 8B); 


which shows that F(x, y) is an increasing function of y in the inter- 
val (79 — 8,79 + B); and since F(x 9, v9) =O, therefore 


PF (X05 0 fa B) <0, F (xo: Vo = p)>0. (4) 


According to the lemma $23 these inequalities remain valid when 
we replace x, by an arbitrary number x which is sufficiently close 
to xq; and since we have agreed above that « can be arbitrarily 
small, we have every justification to assume that the inequalities 


B(x, Yo =p)<0; F (x, Yo oF 6) >0 (3) 
are satisfied at every point x in the interval A (xy) — %, %9 + 4). 
Let us choose and temporarily fix an arbitrary point x in this 
interval and assume that 


F(x, y) = (9) (yo — 2S I<Io + 8B); 
we have: 


a (¥) = F', (x, y)>90 Oo _ Bo ySPv ae B), 


and since the function ¢(,y) increases in the interval (yy 9—f, 99+8) 
and since it also follows from (5) that 9 (y»—8) <0 and ¢ (y9+8)>0, 
therefore a point y* can be found between», — B andy» + 8 for 
which 9 (y*) = 0 or, which is the same 


F (x, y*) = 0. 


The number y* which is uniquely defined in the way described for 
every x in the interval A isa function of x in that interval and we 
shall denote it by f(x). We have thus proved that for every x in the 
interval A only one value of y exists which ts confined between yy — B and 
yo + Band satisfies the equation (3). We have denoted this value by 
fix). We have f(x) = Jo» since the value y = 9 satisfies both the 
necessary conditions for x = Xo. 
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2°. Continuity of the function f(x). 


We will now show that the function f(x) which we defined 
above in the interval A is continuous in that interval. Let x; be 
an arbitrary point in the interval A and let ¢>0 be as small as we 
please. Let us assume that f(x1) = y; so that yy — B<y;<yotB. 
Since the point (1,71) belongs to the rectangle R’, another rectangle 
R" (x, — A Sexy + ASy1 — HS yy + #) can be found with. 
centre at (x ,,91), which lies entirely within R’; evidently we also 
have the justification to assume thatu<e. We have F’, (x, y)>0 at 
every point of the rectangle R"; also F’, (x4, y)>0 for |y — yi|<p, 
ie. F’(x,,”) is an increasing function of y in the interval (yi—p, 
y1 +p); and since F (x1, 71) = O, therefore 


F(xy 91 — vw) <0, Fea, 91 + w)>0. 
Applying the lemma §23 again we can conclude that the inequalities 
F(x, 91'— 8) <0, F(x, + w)>0 


hold for all values of x in an interval (x, — 5, x, + 5) and we cam 
assume that <A, Therefore for every x in the interval (x ,—8, x,+-6) 
a number »* (7, — w<p*<y, +2) can be found such that 
F(x,y*) = 0. Since u is less than «, therefore y* lies in the interval 
(yi-e,. 91 +). On'the other hand, since R’c R’, therefore the 
interval (71 — 491+ uw) and the number »* lie in the interval 
(yo — 2:70 + 8). But we have shown in 1° that only one number: 
y == f(x) lies in that interval, which satisfies the equation F(x, y)=0. 
We therefore have »* = f(x) and consequently 


gi e<f(x)<ji te 


for every x in the interval (x, — 5, x1 + 5). Since ¢ is arbitrarily 
small and x; an arbitrary point in the interval A, it means that 
the function f(x) is continuous in the interval A. 


3°. Uniqueness of the function f(x). 
Let 9 (x) bea continuous function in the interval A so that 
@(xo) =Jo - -F[x; e.(x)] = 0 (x9 — & <e<xq +a). 


Ifwe have 4g —B< <i o'(x)y < yo + @ in the interval A, thenasa result 
of 1° 0 (x) is identitally’ equal to f (x). It therefore remains to’show 
that (x) cannot’ assime'values in the interval: A, which-lie outside. 
‘the interval “(3 —- B, 9 4°)! “Let °@-(x)-be such a value and‘"let 
o(x) > yo + B. Since ? (x9) = 99 <-¥0°+ B; therefore it folléws-from. 
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U 


continuity of the function ? (x) that a point x* can be found between 
xg and (x) at which ? (x*) =») + 8. But in that case F [x*, 
o(x*)] = F[v*, 95 + 8] = 0, which contradicts the second of the 
inequalities, (5) since the point +* evidently belongs to the interval A. 


4°. Existence and continuty of f' (x). 


Since, according to our assumption, the function F (x, y) has 
continuous partial derivatives in the rectangle R and hence also in 
the rectangle R’, therefore, according to theorem 2 § 90, it is differen- 
tiable at every point (x, y) of this rectangle, z.e. in transition from the 
point (x, y) to the point (x + A ¥,» + A y) wehave: 

AF=F(xe+ Ax,y + Ay) — F (x9) 
oF 


=f arth ay tole, 


where o = VA x° + A y*® The increments Ax and Ay can in 
this case be arbitrary. Assuming that the points « and x -+ A x lie 
in the interval (x, — %, x9 -+ #) we can now assume that 


=f) 7 + A= f(x + AN) 
so that 
Ay = f(x + Ax) —f (4); 
where Ax remains arbitrary. We evidently have 


F (x, 9) = F(x + Ax, y + Ay) =0, 
and, consequently, also 


: OF oF 
= — ¢ = 0 
AF Ae Anta, Ay +0 (0) : 
hence 
OF oF ee ae 
pn =e = —— Ax A > 
ax Arta, Ay=o(e:) =0 (VAX + AY) 
or ° 





sr AP a(n 14 ED) =o t4 


since we always have /1 + a* <1 + |4| which can be Droved by 
squaring both sides. It cteretone follows that 


Ox “er x panne se 8 ay ° 





, 
as fi 





rs: Rha cing 
| nn ee a 
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‘A — 0 for ¢ — 0; therefore 


CE ene 
Ay _ Ox 
Se 
Ax gt = 
Oy 


“We have shown in 2 © that the function y = f (x) is continuous in the 
interval (xy — %, *9 + «) ; therefore A »—Oas A x — Oand there- 
fore:also p -> 0 which implies in its turn thatA > 0. But the quan- 
tities 9 F/9x and @F/0» are constant for Ax — 0 and the latter is non- 
zero ; hence the last equation gives : 


oF 
ba a ee BG ce ONE 
io AG ia OF * 
Oy 


This evidently concludes the proof of all statements expressed 
by theorem 1. The expression obtained for f"(x) is the same as what 
we have obtained in § 92. 


It must be stressed that theorem 1, like many other theorems 
on existence of implicit functions, has a local character : it descri- 
bes the behaviour 0! the function F only in a neighbourhood of the 
point (xo).Vo) (in the rectangle R) and the behaviour of the function f 
only in a neighbourhood of the point x9. Generally speaking either 
neighbourhood can be as small as we please. 


A natural generalisation of theorem | is expressed by the foilow- 
ing determining equation : 


FB (x15 X95 wera Xny J) = 0 (6) 


‘which can have any number of independent variables. If F=0 and 
aFlay ~ 0 at the point (x19. X29, «2-5 ¥no2_Vo)> then in a neighbourhood 
of the point W (x19, ¥ 20, ++) Xo) @ Unique continuous function »y = 
S (X15 %9) ++) ¥n) exists which satisfies the equation (6) and becomes » 9 
at the point WV; this function has continuous partial derivatives with 
respect to all variables, whose expressions can be readily found. The 
proof of all these statements is exactly the same as the above proof of 
theorem 1. 


For exercises to § 103 ef. Problem.Book by B.P. Demidovich, 
Section VI, Nos. 232,'235, 237, 275. 
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§ 104. The general problem 


We shall now consider the general problem and restrict our- 
selves to the consideration of two determining equations. The tran- 
sition from two equations to three, then from three to four, and soon 
does not involve further technical difficulties but merely requires a. 
more complicated notation. 


Let the following system of equations be given 


Fy (x, 9, 2) = 0, (1) 
Fy (x,y, 2) = 0, 
2 

(for the sake of simplicity of notation we have chosen a problem with 
one independent variable), where the functions F, and Fy, are conti- 
nuous and have continuous partial derivatives with respect to all the 
variables in a region P of values of these variables ; this region may 
be chosen in the form of a rectangular parallelopiped. Let M (x5, 
Yo; Zo) be an interior point in the region P and let its coordinates 
satisfy the equation (1): 


Fy (Xo 0 Zo) — 0, 
Ps (Xo. Jos Z9) oe 0. 


We want to establish the conditions when a unique pair of continuous 
functions exists 


I =fi (); z= fe (x), 


which identically satisfy the equations (1) in a neighbourhood of the 
point + so that 


ti (*o) = Io, Fa (¥o) = Zo 


We shall also be interested in differentiability of these functions. 


Let us at first assume that out of two partialderivatives 0 /\/dz 
df ./az at least one is non-zero at the point M. Let us assume 
that 


oF, 


ne 


at the point AZ. It then follows from theorem | § 103 (extended to 
two independent variables) that in a neighbourhood Q of the point 
N (x 9,79) in the (x»)-plane the unique continuous fuuction 


z= f (x, 9); 
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exists, which satisfies the first of the equation (1) and assumes the value 
Zq at the point .V; this function has continuous partial derivatives 
with respect to x and y in the neighbourhood Q of the point VW. Hence 
in the neighbourhood Q of the point VV we have identically with 
respect to x and 7 


Fy [x, 9 f (x, 7)] = 0. Q) 
Let us now assume 
Fy fx, vy f (x, y)) = ® (x,y) 


and note the following. If we succeed in finding a continuous 
function 


? = f1(x), 


which identically satisfies the equation ® (x, y) = 0 in a neighbour- 
hood of the point x9 and is equal to yo at the point xo, then assuming 


z = fix, fi (x)] = fo (x), (4) 


we note directly that the functions f, and f, satisfy all the necessary 
requirements; in fact, the relation (2) is identically satisfied with 
respect to y and therefore remains valid when » is replaced by any 
continuous function of x, for example, when y = /, (x) is replaced 
only by /; (*9) = 909; therefore in a neighbourhood of the point 
X 9 we have identically 


Fy {x, fi (x), fly fi (x)]} = Fy {x, fy (x), fo (x)} = 0. 


On the other hand, we have defined the function » = f, (x) as the 
solution of the equation 


® (x, ») = 0, 


and therefore the relation (3) gives identically in a neighbourhood 
of the point x y 


O[x, fa (x)] = P, {x fy (x), Flee fa (x)]} = 
= Fy ix, fy (x), fe (x)} = 0. 


Hence the functions » = f,; (x), Z = f2 (x), in fact, satisfy both 
equations (1) in a neighbourhood of the point x9. On the other 
hand, it follows from the definition of the function /, (x) that 


Sil%o) =Io 
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and therefore 
Se (%o) =Sl¥o fi (ol) =F os Vo) = Zo 
according to the definition of the function fi 
Hence we must solve the equation 
® (x, 7) = 0 


with respect toy. It is evident that all assumptions made with 
regard to existence of the required solution » = fj(x) are apparent 
from theorem | § 103 if we have at the WV (x9 379): 
: ie 
@ 
a Os 


Jet us now consider what these requirements avolve: It follows from 
definition (3) for the function ® 


o® OF 2 oF Of (5) 
Oy 0 yee OZ Oy’ 
but the identity (2) gives us after differentiation with respect toy: 


OPE FOL OF. 
Oy oz OD 


hence (since @F',/0z ~ 0) 





aF 
of ay, 
oy Fy? 

Oz 


substituting this expression on the right-hand side of the equation 
(5) we obtain: 


ge ro 





oy OF, L oe Oy Ov 0% 
0Z ; 
oF, OF: 
a ee ee ae 
FOF, OFsi 
0z | ez OY | | 


Hoy 


The condition that g/d 0 at the point WV is thus equivalent 
to the requirement that we should have at the point'M (x9, Yo, Zo): 
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OF OF 
Oz 0) | 0 
eee aa? 
02 Oy | 


The determinant on the left-hand side of this inequality is 
known as Osirogradskij’s determinant for the functions Fy, I’, with 
respect to the variables z, y and we shall denote it by 


We thus arrive at the condition that the determinant 7 should 
be non-zero at the point M (x9, 709, Z 9). Let us note that the 
condition made from the beginning that out of the two derivatives 
oF ,/dz and @F ,/9z at least one should be non-zero at the point M, 
simply follows from our new condition since, if both these derivatives 
vanish, Ostrogradskij’s determinant has a column consisting of 
zeros and it therefore also vanishes. 


Let us therefore assume that 7 ~ 0 at the point AJ. We then 
have @®/9 y 4 0 at the point (x , 9) and the solution of our problem 
is assured. And since the functions /,(x) and f.(x) were obtained 
in this process as a result of the second application of theorem 1 
$103 which always guarantees continuity of the resulting solutions 
and that of their derivatives, therefore the functions /, and /. and 
their derivatives f,' and /,’ will also be continuous in a neighbour- 
hood of the point + 9. 


We must now prove uniqueness of the solution. Let us assume 
that we have two functions f*, (x) and f™*, (x) in a neighbourhood 
of the point x 9, which are continuous and satisfy the conditions 


F (x, Fis f* 2) =0, Fy, (x, f*1, f* 5) = 0 (6) 


and are such that 


t*1(%0) =Io SF * 3 (x0) = £03 (7) 


we will show that we have identically (*, = fy, f*. =f, ina 
neighbourhood of the point x 9. 


*) This notation which is generally accepted is connected with the name of 
the German mathematician Jacobi whom the development of the theory and 
applications of Ostrogradskij’s determinants (‘‘Jacobians”’) is usually attributed. 
However, Ostrogradskij himself obtained most of the more important results 
several years before Jacobi. 
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We have already mentioned above that the relation (2) is. 
identically satisfied with respect to x and y in a neighbourhood of the 
point (x9,_79) and it will therefore also be satisfied in a neighbour- 
hood of the point x, if we replace y by an arbitrary continuous. 
function of x which becomes y, at the point x9. It follows from 
(7) that we can take the function /*, (x) for this purpose so that 


Filly t* f(x, fal = 0 (8) 


in a neighbourhood of the point +. But, on the other hand, it 
follows from (6) that 


FyLx, "15 f *2)) =9, (9) 
and since z = f(x, y) is the wnique continuous solution of the equation 
F, (x, 9, 2) = 90, 
which is equal to z) at the point (x 9, yo), therefore it follows from 

(8) and (9) that 
(x, 771) = f* (10) 


in a neighbourhood of the point x». But it follows from (3), (10) 
and (6) that in a neighbourhood of the same point x 4 


® (x, f*1) = Fe lx, fia f (ef) = Fela Ma fe] = 0. (11) 
And since, by definition, the function y = /; (x) is the unique conti- 
nuous solution of the equation 

® (x, y) = 0, 
which becomes y, at the point x, therefore it follows from (11) that 
Si (x) = fi (x 
in a neighbourhood of the point «9; it also follows from (4) and (10) 
that 
S* 2 (x) = fal), 


which was to be proved. 


The result of the above investigation can be stated in the form 
of the following theorem. 


Theorem 1. Let the functions F, (x, y, z) and Fy, (x, y, 2) be 
continuous and have partial derivatives with respect to all variables.in a 
neighbourhood of the point (x 9, 7 Zo) and let at that point 
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D(F i. Fe) = 
D(», 2) 
In that case a unique pair of continuous functions 
y= Sfilx), = fo (x) 


exists in the neighbourhood of the point xo, which satisfy the equations (1) and 
the conditions fy {x 9) =23 0, fo(%o) = Zo. These functions have continuous 
derivatives in the nzighbourhood of the point x9. ; 





F,=0, fF, = 0, f= 


We have already mentioned above that we can extend this 
theorem by means of induction to hold for an arbitrary number m of 
‘determining equations with left-hand sides F,, Fy,..., Fm and m+n 
unknowns 91, Jo)+- +> Dm X1) X93 +++) Xn. The necessary condition 
for expressing the variables yj, y»,..., .¥m uniquely as functions of 
4, %9)---,%¥m” in a neighbourhood of a given point is that at that 
point 





— D(Fy Favs Fm) 2 9 
J ie ere ae ? 
where 
oF, OF, OFy 
Oy 1 Ovo ; OI m 
OF, OF, — aFs 
J = 071 O02 7 OI m: 
; ee ; 
Fn OF in OF mn 


a4 Cy 2 aad Odin ; 


is Ostrogradskij’s determinant for the system of functions Fy, F,,..., Fim 
with respect to the variables 71, 92, ..+ 5Jm (here we no longer take 
notice of the usual conditions of continuity and differentiability which 
are the same in all cases). 


It is very important to note that all propositions established 
above are of focal character: in all cases the properties of equations 
in a neighbourhood of a given point imply existence of solutions in 
the neighbourhood of a definite point; our theorems, however, tell 
us nothing of the dimensions of this neighbourhood. 


It now remains to show in what way it is possible to express in 
the general case the derivatives of the required functions f/; in terms 
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of the partial derivatives of the given functions F;. Let us consider 
this problem in relation to the conditions of theorem 1. Since in a 
neighbourhood of the point x) we have identically: 
Fy [x, fi lx), fe (x)] = 0, 
Fy (x, fa (x), Se (x)] = 0, 
therefore by differentiating these identities with respect to x we obtain 
(remembering that we have already established existence and conti- 
nuity of the derivatives f,' (x) and fe’ (x)) 
af, tad , ids 9) 
ox ay dx oz dx | 
r (12) 
OF, Ody , Wada 9! 
ox Oy dx dz dx : 
Regarding df; / dx and df, | dx as the unknowns of this system 
we obtain for them unique expressions in terms of the partial deriva- 
tives of the functions F, and F, since the determinant of the system 


{12) is Ostrogradskij’s determinant F which is non-zero in the neigh- 
bourhood in which we are interested. We therefore obtain: 





dfy __ 1 (oF, oF __ os Ot 
dx fl ex ex oz \ 


Citas, ioe 


dx ff 


§ 105. Ostrogradskij’s determinant 


jenn he _ oFs Of 
cx OD ox Oy 


s we have learnt in the last paragraph, 


1. General properties. A 
.5 Jm) of the system 


the determinant J=D(Fi, Fe...) Pa) | D1 Des 
of m functions Fy, Fs;--, Fim of m variables 4)’. +++5 J’m on which 
these functions depend is of great importance in functional solution 
of a system of equations (or, which is the same in the theory of impli- 
cit functions.) However, the above determinant is also used in 
other analytical problems and has many applications; we must, 
therefore, regard this determinant as an important instrument in 
analytical arguments and calculations. If we are given m functions 
Fy, Foss Pm of m variables yi, V2 s:"+» Im and if, within the scope 
of the problem, we wish to generalise the concept of derivative of one 
variable to include our case so that this generalised form could be 
expressed by a single number (irrespective of m), then in a majority 
of cases it is convenient to take the determinant 7 as this number. 
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This was the position in § 104 where we considered existence of impli- 
cit functions; this can be clearly seen by comparing the theorems. 
in § 103 and § 104. 


The reason behind this general phenomenon which makes us 
regard the determinant 7 as a ‘“‘derivative of the system of functions 
Fy, Foy, Fm of a system of variables yj, 75, +.» ¥m’’ is due to the 
fact that most important properties of these determinants are similar 
to those of the usual derivatives ; we shall now consider several simple 
properties but for the sake of simplicity we shall restrict ourselves to 
the consideration of the case when m=2 (although all properties 
which we shall consider hold for every m). 


Let the functions x = x(u, v), » = (u,v) be continuous and 
have continuous partial derivatives with respect to u and v within a 
region of values of these variables and let in this region 


For the system of functions 


Fy, (x,y, u,v) == x — x (u, 2,), 


FY, (x, 9, u,v) = y — y (%, 2), 


all conditions of theorem | § 104 will be satisfied in the neighbour- 
hood of every point (x9, ¥. Mp: Y%) (where (ug, 9) belongs to the given 
region, vy = x (2, %) and yy ==» (up, %)). This theorem therefore 
enables us to conclude that a unique pair of reciprocal functions 


usu (xp) v=v0 (x, 7) 


exists in a neighbourhood of the point (xg, 7%); we can also maintain 
that these functions are continuous and that their partial derivatives 
with respect to x and y are continuous. 


Let us now assume that we are again given x = x (vu, 2,), 


y =» (u, v) and let uw and », in their turn, be functions of new varia- 
bles s and ¢: 


CS BAS Dt =U: (Ot), 


where these functions are subject to the usual conditions of continuity 
and differentiability. x and y are now ‘“‘composite” functions of s 
and ¢: 


x=xfu(s,t,06,0)]. »9 =prl[uG, d,02 (, Ob). 
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According to the rule for differentiating composite functions 
{§ 92) we have: 


Ox OxdUu , Ox Ov Oy _ ov A EL Ov 
S$ Quds ou os Os “uo ov as’ 


and we have similar formulae for 9 x/d¢and 0y/d%. Therefore 








D (x9) uw ds ' dvds Quds avs | 
= | 1 
Dis)” lax au, ax av ay au, aya |’ | 
1au ot vo ou ot dv ot 
But on the other hand 
ge 10 
Dilepycs ye" 02 | 9) 
D(u,v) , (2) 
oy OD: 
"au dv 
Ac 
CN ae a ; 
D (s,t) dv dv) (3) 
os ol 


According to a well-known law for multiplying determinants 
the determinant (1) is equal to the product of the determinants (2) 
and (3) ; therefore 
D (x,y) _ Dx, 9)  D (u, v) 


Dit) — Due)" Dis (4) 








This relation (which remains valid for determinants with any 
number m of rows and columns) tells us how to construct Ostrograds- 
kij’s determinant for a system of composite functions ; this method is 
exactly similar to the law for differentiating a composite function of 
one independent variable 


dx dx du 
ds duds’ 


i 
i 


x = x (u), u =u (5s); 


In particular, assuming that s = x,t = _y (ze. returning from 
the new variables uw, vto the old variables x, ) we obtain from the 
relation (4) 


Dixy) Du») _ D(x,9)_ 1 
D (u, 2) * De) D(% 9) | 0 





=1; 


> 
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this shows that Ostrogradskij’s determinants for the system of given 
functions and for the system of reciprocal functions are mutually” 
reciprocal ; this rule is exactly the same as the rule 


d 1 
y= P(X) S x= x (y); as 
dx 


for differentiating reciprocal functions when we have a function of one: 
independent variable. 


2. Ostrogsradskij’s determinant as the local coefficient of an ex- 
panding area. We shall now consider one very important geometrical 
application of Ostrogradskij’s determinant which we shall find useful 
later; here we shall again restrict ourselves to the consideration of the- 
case when m = 2. 


Let thé functions 
u=u(x,y), 0 = 2 (x, 9) (S} 


be continuous and have continuous partial derivatives in a region of 
the XY-plane and let in this region 


D (u, v) 
D (x, 9) wave 





Let us analyse the transformations (5) of jvariables from a. 
geometrical point of view. Let u and v be the cartesian coordinates. 
of the point (u, v) inanew plane 
which we shall call the UV- 


plane. It then follows from the 

ye relation (5) that,each point 
0 A (x, y) in the given XY-plane: 

corresponds toa point Q (u,z) 

0 XY O y in the UV-plane (fig. 63). If 

Fig. 63. we assume that the point P moves. 

within the region of the X Y-plane,, 

then the eerreshondine point in the UV-plane will change its position 
in a quite definite manner. Hence every curve in-the’ XY-plane will 
correspond to a-definite curve.in the UV-plane and each -figure ‘in: 
the XY-plane to a certain figure in the UV-plane. Also\the region: 
in which the functiens (5) are defined in the XY plane will be trans- 
formed into 4d new region in the UV-plane. 


Y V 


. 
| i 
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Let A (a, 6) be a definite point in the ¥%-plane, which lies. 
within the region in which the functions (5) are defined and let / be- 
a small positive number. The points A (a, 5), B (a + h, 6b), Cla +A, 
b+ h), D(a, b +h) (fig. 64, a) are evidently the vertices of a square 
with side h. As result of the transformation (5) these points become: 
the points A’, B’, C’, D’ respectively in the UV-plane (fig. 64, 6) 
whose coordinates are evidently equal to 


A! [u (a, 6) v (a, 6), 7 
B'tu(a +h, 6), v (a+ fh, 6)] | 
C"[u(at hb +h), v(athb+ h)), 
D’ (u (a,b + hy, v (a,b + h)). 


(6) 


The square as a whole is transformed into a curvilinear quadrilateral: 
A'B'C'D' which is represented in fig. 64, 6. We shall try to find. 





i 
| 2 C 
YF) 
| h 
fe 6B 
io 1} x 


Fig. 63 


the approximate value of the area of this curvilinear quadrilateral ore 
the assumption that the number h is very small. We shall at first 
replace the arcs A‘B’, BYC’, CD’, D'A' of the curves by rectilinear 
chords, keeping their ends the same, and calculate the area of the- 
rectilinear quadrilateral: A’B’C"D’ (fig. 64, 6) which will be equal to- 
the sum of the triangles A’B’C” and A’D'C’. According to a well: 
known :-formula of analytical geometry the area of a triangle with 
vertices (% 4,071), (#2 U2), (%3, Ug) is equal to half of the absolute value- 
of the determinant 


Uy v7} ] i 
. | l Ug — ty lg — Vy 
eae “Uy Ue 1] = 
Ug — Ug Ug — Ug 
htt. Be Ts 


Hence we. obtain the following expression for the area of the triangle- 


AB’C’ : 


480 A GOURSE OF MATHEMATICAL ANALYSIS 


re | u (ath, b) — u (a, d) v (ath, 6) —v (a, b) - 
2 | u(ath, b+h)—u (ath; 6) v (ath, b+h)—v (ath; d) | 
1 | we (ats h, 6) hb u' 2 (a+02 hy b) h 
ND Nd Sct een he = diag he neh - 


he | u' (a+, h, 6) vg (at Oy h, b) 
2 | uy (ath, b+05 A) vy (ath, b+64 h) 
where 04, 95, 83, 04 are numbers confind between 0 and I. 


We assume that the partial derivatives of the functions u and v 
with respect to x and » are continuous and therefore also uniformly 
continuous in the (closed) region under consideration. It follows 
from continuity of the partial derivatives at the point (a, 4) that, pro- 
vided h/ is small, all elements of the above determinant wlll differ by 
as little as we please from the values of the corresponding derivatives 
at the point (a, 6) and the determinant itself will differ by as little as 
we please from the determinant , 


u', (a,b) 2’ » (a, 5) 


»d = ’ 
a u' y (a, b) v'y (2, b) | 





i.e. from Ostrogradskij’s determinant for the functions u,v of the 
variables x, y at the point (a, 6). Therefore we have the following 
expression for the area of the triangle A’B'C’ when h -> 0: 


EE sled 





A? 
+ of =>) F(a b)| ++ 0 (RY) ; 


but a similar calculation shows that the same expression will be 
obtained for the area of the triangle A’D’C’ so that when h — 0, the 
area of the whole rectilinear quadrilateral A’B’C’D' is equal to 


h | F (a, b) | + 0 (A) ; 


it is important to remember that the evaluation thus obtained holds 
uniformly with respect to all possible positions of the point (a, 6) in the 
region under consideration. *? 


*) This means that, when #-> 0, the ratio of the second term to 42 tends to 
zero uniformly with respect to @ and 6 in the given region, 
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We must now return from the rectilinear quadrilateral A’B’C’D’ 
to the curvilinear quadrilateral with the same vertices. How- 
ever, the difference in areas of these two 
quadrilaterals evidently does not exceed the 
sum of the areas of four narrow strips which 
are shaded in fig. 64. Therefore in order to 
show that the expression (7) also represents 
the area of the curvilinear quadrilateral 
A'B'C'D’ itis sufficient to prove that the areas 
of the shaded strips are equal to a quantity 
of the type o (A?) ; the calculation is naturally 
the same for all four figures ; let us perform 
this calculation, say, for the figure A’B’ (fig. 65) and let us, for the 
sake of brevity, denote the coordinates of the points A’ and B’ by 
(5,05) and (uw + A u,v, + A v) respectively. 





Let us assume that 7 (a, b) 40; in that case at least one of 
the partial derivatives @u / ax, dv / dx will be non-zero at the point 
(a, b); let gu / ax > O at the point (a, 6); therefore provided A is 
sufficiently small, we have cu / ox > 0 at every point of the square 
ABCD and, in particular, at every point on the side AB of this 
square. Hence if the point (x, y) moves along point that side from A 
to B, the corresponding (uw, v) moves along the curve A’D’ in the 
direction of increasing values of uw; we can therefore represent this 
curve by an equation in the form v = f (uv), where u% <u <u + Au. 
The equation of the rectilinear section A’B’ is evidently equal to 

—f(u 
v= H+ ii) SF (9) Lot ae) 
so that the area S of the figure shaded in fig. 65 can be expressed bv 
the integral 
Uyt Au 


s= [ fw—flu— 


Since y remains constant in the interval 1B, therefore vu and 
v become functions of one variable « and we have: 


du = ov ax) oS pe dx, 
Ox ox 


(u—uo), 





LS to + AW) —S (Ho) au 


therefore 





ee Ne : 
dt Cu 
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since Qu/dx = 0 in the interval AB, it implies existence and conti- 
nuity of the derivative f’(w) = dv/du in the interval (Uo, uo + Au). 
Hence we have for uy) Su uy + Au: 


fit) — f (uo) =(w— 9) f/ (tn), Feo AWS (to) = wry” (12), 


where wu, and w, are confined between uy and uy + Au; thus the 
expression obtained above for the area S can be written in the form 


ug+ Au 
S = | (u — uy) | f' (4) — Sf’ (we)! du, 

uo 

and since the function f’(z) is continuous for Au — 0 
ot Au 
S =o ( i (tu — to) du) =0 (An?). 
ug 

But 

Au =u (a + h, b) — u(a, d) 


4s an infinitely small quantitv of the same order as fh for h > 0 and 
we therefore obtain: 


S = 0(h%), 


‘which was to be proved. 


We can therefore say that the area of the curvilinear quadri- 
Jateral A’B’C’D’ resulting from the transformation (5) of the square 
ABCD is equal to the expression (7); this evaluation holds uniformly 
in the region under consideration with respect to the position of the 
“point (a, 6). Since the area of the square ABCD is equal to /?, the 
ratio of the transformed and initial areas is equal to 


|F(a, 6)| + 0 (1), 


and the limit of this ratio for h — 0, is equal to | 7 (a, 0) |. 


This result can be greatly generalised. Instead of the square 
ABCD we could have taken any other sufficiently simple figure 
containing the point A (a, 6) and we could subsequently have shrunk 
it so that its diameter should tend to zero; in this case (as can be 
seen from a more detailed analysis which we cannot give here) the 
ratio of the areas of the transformed and given figures will always 
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tend to the limit |. F(a, b)|. Hence the absolute value of Ostrograd- 
skij’s determinant for the transformation (5) can be regarded as 
the coefficient of expansion or contraction of areas resulting from the 
transformation (5) in the immediate neighbourhood of the point 
(a, 6), This result is very important in the theory of multiple 
integrals which we shall study in the next section. The geometrical 
part played by Ostrogradskij’s determinant can be extended to a 
space of an arbitrary number of dimensions. Thus in the transfor- 
mation of a three-dimensional space Ostrogradskij’s determinant 
for this transformation gives us the coefficient of volume expansion 
or contraction of small geometrical bodies which lie completely in 
the neighbourhood of a given point. 


§ 106. Conditional extremum 


In this paragraph we shall consider the theory of the so-called 
condilional extrema (maxima and minima) to which theory of implicit 
functions can be directly applied. 


Let a certain surface be given in space, which is defined by 
the following equation 


F(x, 9,2) = 0; (1) 


we must find a point on this surface at which a function f(x,y, 2) 
assumes the greatest (or smallest) value as compared with other 
points on that surface. From the analytical point of view this 
implies finding the maximum (or minimum) of the function f(x, y, z) 
for all possible combinations of the numbers x,y,z which are 
connected by the relation (1); this problem differs from the usual ex- 
tremum problems by the fact that a connecting equation (1) is given, 
j.e. that we are interested in the comparative value of the function 
f (x3, Z) only at points subjected to the relation (1). 


It may happen that the point at which the given function f 
assumes its greatest or smallest value may be one of the points on a 
line expressed by the equations 


Fy (x, 3, z) = 0, 


F, (x,y,z) = 0. (2) 


From an analytical point of view this implies that among all combi- 
nations of the three numbers (x,y, 2) which satisfy the relation (2) 
there must be a point at which the function f(x, y z) has its greatest 
or smallest value. 
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In all such cases we speak of a conditional extremum of the 
function f(x, y, Z) bearing in mind the fact that at the point which 
we are trying to find, the function f(x, y, z) assumes its greatest or 
smallest value only in relation to points which satisfy some additional 
conditions of the type (1) or (2). These relations are usually called 
connecting equations characteristic of the given problem. The most 
general type of conditional extremum problem can evidently be 
formulated as follows: among the points (x1, % 9)... 5 %n) which 
satisfy the connecting equations 


Bg (815 Xa9-065 Xn) = O (@ = 1,2,...,m; m<n), 


a point must exist at which the given function f(%1, *2. ... > Xn} 
assumes its greatest or smallest value. In such cases, as in ordinary 
extremum problems, the region of values of the variables x; (I1<i<n)} 
in which we are interested is usually given beforehand. 


If some m variables (for example x1, *9, ---,%m) can be 
determined in this region as single valued functions of the other 
variables (%m41,---:%n) by means of m connecting equations 


Xi = Pi (Xmis Xmta, «0 » Xn) (¢ = 1, 2, ..., m), 


then by substituting their expressions into the formula for the 
function / we evidently obtain a function of the variables (x,.41,...,%n) 
whose extremum is now sought among various systems of values 
of these variables which are no longer interconnected, z.e. we now 
have a simple extremum problem whose solution has been considered’ 
in $96. It is therefore obvious that in conditional extremum 
problems it is very important to solve the system of connécting 
equations with respect to a certain group of variables; thus the 
general theory of a conditional extremum is closely related to the 
theory of implicit functions. 


In order to simplify notation and clarify the arguments used 
we shall now consider the case when n = 5, m = 2, i.e. the problem 
of the conditional extremum of the function f(x, y, z, u,v) of five 
variables which are related by two connecting equations: 


Fy (x, 9, & U, v) = a 


PF, (x, 9, Z, u,v) = 0. (3) 


All arguments which we shall use in this connection can be used 
without modifications for every n and m. Therefore, as in the case 
of a simple extremum and for the same reasons, we shall onlv 
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consider the properties of the relative (local) conditional extremum, 
and, as before, we shall restrict ourselves to the deduction of the 
necessary conditions of general character, for we are now even less 
able to go into further details. 


Let us therefore assume that at a point M (x9. v9, 2, Uo, %) Whose 
coordinates satisfy the connecting equation (3) the function 
S (x;y, 2, t, v) assumes the greatest or smallest value as compared 
with all sufficiently closely situated points whose coordinates also 
satisfy the equations (3). Let us write a matrix with two rows and 
five columns 


OF oF, oF, oF, OF 
ox ay 0g Qu oD 
QF, OF, 0F, OF, oF, 


ox cy 6£ du adv 








and assume that among the determinants of the second order which 
can be composed of the elements of this matrix there is at least one 
which is non-zero at the point M. Let us assume that this is the 
determinant 





OF OF) 
| 2 Gv 
|@F, oF, a 
| au Gv 


In that case (assuming that the usual conditions of continuity and 
differentiability are satisfied by the functions F, and F,) we can con- 
clude from theorem | § 104 that a single pair of functions exists 


uu (2595 Z), v= dv (45.9; 2) 


which identically satisfies the equations (3) in a neighbourhood of 
the point P (%9, ¥, 2) and for which 


U (Xp, Por Zo) = Yo» U (Xos Jo» Zo) = % 


In a neighbourhood of the point P these two functions are con- 
tinuous and have continuous partial derivatives with respect to all 
three variables. 


Since in our problem we are interested in the values of the 
function f (x, y, 2, u, v) at points close to the point M whose coordi- 
mates are connected by the relation (3), we can replace uz and v by 
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the functions u (x,y, 2) and v (x, », z) respectively in the expression 
of this function and maintain that the function of x,y, z so obtained 
¢ (x,y z) = f [x, 9, gu Ce ds Z); v Co; z)] (4) 
has a simple (ordinary) local extremum at the point P (xp, %, 2). It 
follows from § 96 that we should therefore have at the point P 
ox oy az : 
according to the expression (4) the function 9 gives us: 


af . afou , afd _ 4 


] 
ox | Qu Ox gu Ox | 
. 

oy Qu oy cv ay ; 
I 

| 

J 


af , afeu, ef av _ 
ez o au cc | OU Gz po 


In order that the left-hand sides of these equations could be 
regarded as given functions of x, 7, z, u,v we must express Qu / 0x; 
ou | ox, Ou / Oy, dv / Oy. ou | dz, av / Oz in terms of the five variable 
functions. But this necessitates differentiation of implicit functions 
which we have considered in detail in § 104. As before we shall 
differentiate the following identities with respect to x, » and z: 


Py [x, 9, , u(x, y, 2), 9 (X, », 2)] = 9, 
Py [iy J Ry Ul (x5); rae v (x, Ds z)] == 0, 


whence we obtain: 





Fy OF a, Ow g ) 
ox Qu Ox qv ax ? ‘ 
af, | OF, ou , Fe av 
ex | Ou ax qu ax 


| (6) 
=0 | 


and similar relations for the derivatives with respect to y and z. As. 
usual we can use the equation (6) in order to express uniquely the 
derivatives gu / 0x* and Qu / @x in terms of the partial derivatives of 
the given functions /; and F, (the determinant of the system (6) is 7 
and, according to our assumption, it is non-zero at the point M and 
therefore also in a neighbourhood of that point). It is obvious that 
systems similar to the system (6) and written for derivatives with 
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respect to y and z, will give us analogous expressions for 0u / 0), 
dv / 09, du / Oz, dv/ dz Replacing these expressions into the rela- 
tions (5) we obtain three equations whose left-hand sides can now be 
regarded as given functions of x, 7, z, u, v. Adding to these equations 
the connecting equations (3) we obtain five equations whose left-hand 
sides contain known functions of the variables x, y, z, u,v. We have 
shown above that this system of five equations with five unknowns 
should give the coordinates of the point M provided this point is the 
required conditional extremum. It is therefore natural to call every 
system of five numbers (x, y, z, vu, v), which satisfies the system of 
equations obtained, as stationary point of the given problem. The 
result can then be stated in the same way as the results obtained 
earlier for simple extrema: provided the usual conditions of continuity 
and differentiability of the given functions are preserved, the function 
can only have local conditional extrema at stationary points. Natu- 
rally the question whether this or other stationary point gives the 
local extremum of the function f and, if so, what is the nature of this 
extremum, cannot be answered on the basis of the above considera- 
tions and must be investigated separately. 


We have seen above that the first three equations of a system 
of five equations available for the determination of stationary points 
are obtained as a result of solving the system of linear equations (6) 
with respect to ¢u / éx and @v/ éx and the substitution of the resulting 
solutions into the first of the equations (5); the same operations are 
subsequently carried out for derivatives with respect to y and z and 
the results obtained are replaced respectively in the second and third 
of the equations (5). It is clear that there would be no great diffi- 
culty in carrying out all these simple operations and writing the final 
system of equations in ja definite form (this would evidently contain 
only partial derivatives of the functions f/, /’, and J, with respect 
to all five variables). However, we shall not do so, for in practice we 
can usually obtain the final system of equations for the determination 
of stationary points by means of another simple method, wiz by the 
so-called ‘“‘method of undefined factors’. We shall now show how 
this is done. 


The sequence of operations described above essentially involves 
an elementary algebraic operation — elimination of six unknowns 
du /ax, ov | dx, ou / Oy, dv / OY, Ou / 0z, dv / 0z from nine linear equa- 
tions ((5), (6) and four analogous equations (6) for the derivatives of 
the functions w and v with respect toy and z). This elimination can 
naturally be carried out in different ways. Thusin the method used 
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above we have obtained expressions for all the unknowns eliminated 
from the last six equations and substituted these expressions in the 
equation (5). In practice this method is often inconvenient owing to 
its asymmetry: the part played by the unknowns u and v differs 
essentially from that played by the remaining variables x, y, z. The 
main advantage of the method of undefined factors is due to the 
equivalence of five variables. 


Let us assume as before that the point A£ (x9, ¥%, Zo Me: %) gives 
us the required local conditional extremum of the function f and let 
us preserve all former assumptions made with regard to the functions 
Jj; fF, and F, in the neighbourhood of the point M@. The system of 
equations 


of OF Of, _ } 
ep lay tie = 0, | 

(7) 
‘ay Aa au ae > J 


where all partial derivatives are taken at thc point Mf thus has a 
single solution (A,, Ay). Multiplying che equations (6) by Ay and A, 
respectively and adding them term-by-term to the first of the equations 
(5) we obtain at the point M (as a result of (7)) : 


_ pees ——s 7 8 
ax { Ox i 2 ax ? ( ) 


if we now write equations analogous to (6) for the derivatives with 
respect to y and z and combine them in the way described above 
with the second and third of the equations (5), we evidently obtain, 
as in the equation (8), the following equations 


af e OF 2 


i 0,1 
at ay | 
aE 29 


dz J 


The system of the five equations (7), (8) and (9) is evidently 
completely symmetrical with respect to the five variables x, y, z, u, v. 
Adding the connecting equations to these five equations we obtain a 
system of seven equations with the unknowns x, 9, z, u, 0, Aq, Ag 
which (when the usual conditions of continuity and differentiability 
are preserved) should be satisfied at every stationary point. 


thy 
(9) 





— Al A 
ae: 1 3, + A; 
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If together with the given function f we are also considering 
the function 
Og AVP y+ APs 
of the same variables, where A, and A, are undefined numerical 
factors, then the system of equations (7), (8), (9) obtained can be 
written in the form 
aD 2 06oh oh DD 
ex ay) 8ZUCD 
and it therefore represents the system of equations which we would 
have obtained if instead of the conditional extremum of the function 
f we would have sought the ordinary extremum of the function ©. 
In this reduction the definitions of the conditional stationary points of 
the function f and finding of the ordinary stationary points of the func- 
tion ® involves the practical application of the method of undefined 
factors. We thus see that the system of equations which determine 
the conditional stationary points of the function f have two more 
unknowns (A, and A,) than those for ordinary stationary points; 
we now also have two more equations since the connecting equations 
are added. 


Example. The parabolloid of rotation 
| x? ytmz (10) 
is intersected by the plane 
ety tz=1 (11) 


in an ellipse; find the greatest and least distances of points on this 
ellipse from the origin of coordinates. 


From an analytical point of view this problem evidently neces- 
‘sitates finding of the maximum and minimum of the function 
erly apige 
where the equations (10) and (11) are the connecting equations. 
Using the method of undefined factors we eonstruct the function 
D(x, Z=HP PLLA, (x? — 2) +Aa(atyt+z—1) 
and equate to zero its partial derivatives with respect to all three 
variables; this gives : 
No _ Ay mAs, 
a=) >= 9K, 1)? AS ae 2 ? 





490 A COURSE OF MATHEMATICAL ANALYSIS: 


substituting these expressions in the connecting equations (10) and. 
(11) we obtain after easy calculations: 


A= 342-43, i= -T4 3 ¥3, 
and therefore 
Par aes a 
saya TM, 2-2 F v3 


This gives two values 9 = 54/3 for the quantity x? + y? + z°} since 
the case under consideration existence of the required extrema 1s 
geometrically obvious, therefore on furthur investigations into the 
nature of the two stationary points obtained are needed and we can 
consider the problem solved. 


The reader will find further exercises in the Problem Book by 
B.P. Demidovich, Section VI; we recommend Nos. 447, 448, 453). 
456, 465. 


CHAPTER XXV 
GENERALISED INTEGRALS 


§ 107. Integrals with infinite limits 


In this chapter we shall consider two wider concepts of definite 
integrals which are very important in the further development of 
theory and its applications. 


The function 7 = 1 / x is positive in the region + > 1; it is 
continuous, decreases constantly as x increases and tends to zero. 
asx—> co. Let us consider the area 
below the curve y = 1 /x* and above 
the OX-axis between the abscissae 1 
and b > 1; we know that this area 
(fig. 66) can be expressed by the integ- 
ral 


. 1 

dx 
[S-=1-5. (1) 
1 


This area increases as b increases. 
Fig. 66. indefinitely, the shaded figure in fig. 66: 

will extend indefinitely and reach more 

and more to the right; however, its area remains bounded and tends 
to unity, as can be seen from the relation (1). This phenomenon is 
exactly similar to the summation of a convergent series with positive 
terms, for example, a simple geometrical progression ; partial sums of 
series with an increasing number of terms, thus increasing continu- 
ously do not, however increase indefinitely but tend to a definite 
limit; similarly here the shaded part includes an indefinitely large 
area as 6 increases and thus increases continuously but not indefi-- 
nitely and tends to a definite finite limit. And as before we have: 





- 491 


-492 A COURSE OF MATHEMATICAL ANALYSIS 


-agreed to call the limit of the partial sums as the sum of “‘all’’ terms 
-of this series, so now the limit of the shaded figure can be called the 
area of whole figure extending to infinity and bounded from above by 
‘the curve y = 1 / x?, from below by the OX-axis and from left by 
‘the straight line x = | (it is not bounded at all on the right). 


However, partial sums only have limits for convergent series ; 
‘we know that there exist series whose terms are positive and decrease 
monotonically tending to zero while the series themselves diverge so 
‘that their partial sums increase indefinitely without tending to any 
limit (for example a harmonic series). We can have a similar 
position here with the area of the figure which extends to infinity. 
Thus the curve y = 1/x has a similar course to the curve y = 1/x* 
dfig. 66) in the region x > 1; but since for 6 > 


b 

[2 =Ind> », 
x 

1 


‘therefore in this case the area of the shaded figure increases indefinitely 
as 5 increases so that the whole figure extending to infinity has no 
Jonger a finite area. 


Let us agree in general to call the limit, in case it exists, of 
every function f(x) integrable in the interval (a, 5) where @ is as 
‘large as we please : 


b 
lim [ s6) dx, (2) 
b—> ; 


as the generalised integral of the function Ff (x) in the subinterval (a, + <c) 
Aor within the limits from a to + 00), and denote this limit by 


[ 509 dx. (3) 


Tf the limit (2) exists, then the integral (3) is said to be convergent and 
the limit (2) is said to be the value of this integral. Ifthe limit (2) 
does not exist, then the integral (3) is said to be divergent and has no 
value. Here the function f(x) must not necessarily be positive or 
‘monotone; the above definition will have a definite meaning pro- 
‘vided the function f(x) is integrable for every 6 > a in the interval 
(a, 6); this means, it is sufficient to assume that the function f(x) is 
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continuous in the region x >a. In this general case the simple 
geometrical interpretation of the integral (3) which we have used in 
the beginning will evidently no longer hold. 


We have so far assumed that the lower limit of integration. 
remains constant whereas the upper limit increases indefinitely. We 
shall evidently have a similar case when the position is reversed, i.e.,. 
when the upper limit of integration 5 remains constant whereas the- 
lower limit of intergration a, which is negative, increases indefinitely 
in its absolute value (a—> — oo). If the function f(x) is integrable- 
in the interval (a, 6) for every a < 6 and if the following limit exists :. 


b 
lim | J (x) dx, (4); 
a> —@ 
a 
we can denote this limit by 
b 
| fle) ax (5): 


—_—o 


and say that the above integral is convergent and equal to the limit 


of (4); if this limit does not exist, then the integral (5) is divergent 
and has no definite value. 


Finally the case when a -» — «© and 6 + o simultaneously 
and independent of one another is also possible, 7.¢., the interval of 


integration increases and covers the whole number line. We assume 
in this case that the integral 


a 


b 
| f(x) dx = I (a, b) 


tends to the limit J and write 


lun J ‘a,b) = 7, (6) 
a> —o 
b>+o 


if for every ¢ > 0 an A > 0 can be found such that for a << — A’ 
b > A always 


| I(a,6) —T| <e. 
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‘Obviously it is necessary and sufficient for the limit (6) to exist that 
the following two integrals should converge 


+2 0 
| F(x) dx and | f (x) dx, 
0 —@ 


-and when this is so, the limit (6) is equal to the sum of these two 
‘integrals. If the limit (6) exists, we can denote it by 


[ £0) ds, (7) 


-and we say that the integral (7) converges; otherwise we say that the 
integral (7) diverges and we are not able to give it anumerical value. 


Example 1. Since 





b 
| a arctan 6 arcta 
, = ar — arctan a, 
l+x+ 

a 


‘therefore 





5 
fF | dx _ ean; 
im (ae (-5 =e 
a 


a> — oO 
b>+o 


-the integral 


is therefore convergent and equal to x. 
Example 2. Since 
b 
[ cos # dx = sin 6 — sina 
a 


‘and since sin x does not tend {to a limit for x + oo, therefore, the 
‘integrals 


+ b + 
| cos x dx, | cos x dx, | cos x dx 
a — oOo —o 


care all divergent and have no numerical values. 
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Example 3. Since 


‘therefore the integral 


b 


[ eras 


— @ 


is convergent and equal to e? (since e? + 0 as a—» — 00) ;o0n the 
-other hand the integral 


+a 


[eras 


a 


is divergent (sincc e? > + co asb-»-+ 0). Therefore the follow- 
ing integral is also divergent 


The analogy between infinite series and generalised integrals 
prompts us to seek methods for determining convergence of genera- 
lised integrals on the same lines as in finding methods for determining 
‘convergence of infinite series. In future we shall only deal with 


ao 


integrals of the form J; however, all that we shall deduce can be 
a 


applied without essential modifications to integrals of the type 


At first the general theorem 2§ 19 gives us the necessary and 
‘sufficient test for convergence of the generalised integral 


| soo av (8) 
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in the form of the condition that for « > 0 and for all sufficiently 
large 6, and 5, we must have 
bs bi 
[rere —| seas | <e; 
a 


a 


since 
bg by bg 
[7@ &—[so a= [ fo) 
a a by 


therefore this gives us the following test. 

Theorem 1. Jn order that the integral (8) should be convergent it is 
necessary and sufficient that for arbitrarily small ¢ > O the following inequa-- 
lity should hold for all sufficiently large b, and by: 





(in other words, in order that a generalised integral should converge- 
it is necessary and sufficient that any of its sufficiently far removed. 
(and as far as we please) ‘‘part” should be as small as we please). 

In the same way as the necessary and sufficient condition for 
convergence of a series with constant signs is the limit of its partial 
sums, so in order that the integral (8) with a non-negative integrand f(x) 
should converge it is evidently necessary and sufficient that the 
integral 


[rw dx 

a 
should remain bounded for b > o. This fact enables us to establish: 
the principle of comparison of integrals which is analogous to the: 
principle of comparison of series with constant signs (theorem | § 68). 

Theorem 2. Jf we have 0 < f (x) <9 (x) for a<x< +0 

(where c > 0 is a constant) and if the functions f (x) and @ (x) are int-gra- 
ble in every interval (a, b)(a < b), then convergence of the integral 


( © (x) dx 
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implies convergence of the integral 


fy (x) dx, 


and the following inequality also holds : 
[ s@ a <a e[- (x) dx. 
a a 


The proof is similar to that of the principle of comparison of 
series and we can therefore leave it to the reader. 


Example 4. Since « is constnt and x > + oo, we always 


a4 
have x% 2?" +0 (example 7 § 37), and therefore for a sufficiently 
large x 


hence 


1 1 
a en 


x“ 2 
x%e—* = x%e é <e * 


It therefore follows from convergence of the integral 


that the integral 


converges for every constant 4. 


foe] 
ts : es 2 
Example 5. [e dx = 7 3s convergent ; since e-*? < ¢# for 


1 
x > 1, the following integral is also convergent : 
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@ 
2 
[eo dx, 
1 
although we do not know its value. 

We shall not consider simple properties of generalised integrals 
which are analogous to the corresponding general properties of 
infinite series and proved in the same way. Thus it can be readily 
shown that by changing the function / (x) arbitrarily in a finite interval 
(as long as it remains integrable) we cannot affect convergence of 
the integral (8) (although we generally change its value). More- 
over, if both integrals 


oo 


i= [sr (x) dx, I, a (x) dx 


are convergent, then the integral 
r= [ (fi) £ fe (e)} de 
a 


is also convergent and 
i = Ly + I. 
The integral (8) is said to be absolutely convergent if the following 
integral converges _ 


[ 1F09 [ ax (9) 


Convergence of the integra! (9) implies convergence of the integral 
(8); in fact, ifthe integral (9) is convergent, it follows from theorem 
1 that for arbitrarily small <¢ > 0 we have for every sufficiently large 
b, and 6, 
be 
[[iseier| < e. 


by 


But we know (last theorem of § 51) that 





be be ‘ 
fre ar | <| [iret a 2 
a abs Ge 


bye B a4 
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therefore for every sufficiently large 6, and 6, 


and again as a result of theorem 1 this implies convergence of the 
integral (8). 

As in the case of infinite series theorem 2 (the principle of com- 
parison) enables us to establish several concrete tests for convergence 
of generalised integrals which are convenient in practice; we shall 
now consider some simple tests of this kind. 


Theorem 3. Jf > | and the following inequality holds for all suffi- 
ciently large values of x: | f (x) | < cx~%, where c > 0 is a constant, then 
the integral (8) is absolutely convergent ; conversely, if % < 1 and for all suffi-- 
ciently large values of x we have f(x) > x-%, then the integral (8) is 
divergent. 


We assume, as usual, that the function f(x) is integrable in 
every finite interval (a, 6) (a < 4). 
Since the integral 


| x7% dx 


a 


(where a > 0) is convergent for « > 1 and divergent for « < 1, 
therefore theorem 3 follows directly from theorem 2; that we must 
restrict ourselves only to sufficiently large values of x is, of course, due 
to the fact that changes in the function f(x) in a finite interval do not 
affect convergence of the integral (8). , 


It follows directly from theorem 3 that integrals, like those 
shown below, must be absolutely convergent 


sin xy | xdx 
“ee ™ VT x8? 
J 0 


etc. The test for convergence established by this theorem has many 
practical applications ; however we must regard it as rather rough, 
since it can only be used (as can be seen from its formula) to establish 


500 A COURSE OF MATHEMATICAL ANLAYSIS 


absolute convergence of integrals (and other better tests can be found). 
‘We therefore give below another much more sensitive test. 


Theorem 4. Jfa > 0,a> Oand the function 9(x) ts continuous 
for every x > a and a positive number C exists such that for all b > a 


b 
| : 
penne C, 


then the integral 





as convergent. 


Proof. Let us assume that 


| © (u) du = D (x), 


so that 

{P (x) | < Cc (a<x< +o 
Integrating by parts we obtain : 
x 


9D im [LLY ax m (YE 4 0 [2 


ue yeti 





D Cony 32 


a 


If we now assume that x inrceases indefinitely, then the first term 
on the right-hand side tends to zero so that 
® (x) C : 
er igs (x > 00), 
and, on the other hand, ® (a) = 0 according to the definition of the 
function ® (x). The second term on the right-hand side tends to the 
following integral as itslimit for x > oo: 


a | Oe a (10) 
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which is (absolutely) convergent in accordance with theorem 3, since 
% > Oand|® (u)| << C. Hence the limit 


x fos) 
lim (2, — | oe) ny 
xo u u 
a a 


exists (and is equal to the value of the absolutely convergent integral 


(10)). 


Theorem 4 can be successfully used in order to establish con- 
vergence of many integrals which play an important part in various 
applications; a typical example of integrals of this kind is the 
integral , 





| sin ¥ dx, (11) 
x 


which, according to theorem 4, is convergent so that 


=|1—cosx| <2 (O<x< + om). 





x 
| | sin udu 
0 


We will show that the integral (11) is not absolutely convergent (or, as 
is usually said, conditionally convergent), i.e. the integral 


ao 
sin x | 
| L sina! 4, 
x 
a 


(a > 0) is divergent. As always, |sin x| > sin? x and it follows from 
the principle of comparison (theorem 2) that for this purpose it is 
sufficient to prove that the following integral is divergent : 





sin? x 1 — cos 2x 
| 2 dx = [- ” dx. (12) 


i 
a 


But the integral 
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1 


_is similar to the integral (11) and its convergence can be readily esta- 
blished by means of theorem 4. Thus if the integral (12) would be 
convergent, then by adding the integral (13) to it we would obtain a 
sum 


which should also be convergent ; however, this is not so; therefore 
the integral (12) is divergent and the integral (11) is only conditionally 
convergent. We have a similar position with all integrals of the 


‘type 








fO<a<cl. 


For exercises cf. Problem Book by B. P. Demidovich, Section 
VI, Nos. 108, 109, 111, 120. 


In this paragraph we had many occasions to observe the way 
in which the analogy between infinite series and generalised integrals 
is of decisive importance in determining fundamental concepts and 
elucidating main properties of integrals with infinite limits. We will 
now show how the concept of generalised integrals can be conversely 
used for making deductions which are very important in the theory 
of infinite series; by using the concept of generalised integrals we shall 
establish a test for convergence of series with constant signs, which by 
its validity and convenience in practical applications has many ad- 
vantages over all the elementary tests established in § 68. 


Theorem 5. (Cauchy’s integral test for convergence of series). 
Let f (x) be a positive non-increasing continuous function defined for every 
x > a, where a is a constant natural number. In that case the series 


Fat ee ius fee bibs. (14) 


will be convergent or divergent according as the following integral is convergent 
or divergent : 


[ FG) ax. (15) 
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Proof. Since the function f (x) is a non-increasing function; 


therefore we have f (a+) > f(x) ai eekly for BESET A 
and consequently 


atk+1 | ae 
fat> | fWldsdfetkt) ..b=0,1,2,..., 
a+k 
Summing these inequalities with respect to k from 0 to x we obtain: 
atn+l 
Frleri> J f (x) de> y flatk+}). 
k=0 k=0 


If the integral (15) is convergent, then the central part in these in- 
equalities remains bounded for n + co; the right-hand side will also 
be bounded and this implies convergence of the series (14) with cons- 
tant signs; if, however, the integral (15) is divergent, then the central 
part will increase indefinitely for n > oo; the left-hand side will also 
‘Increase and this shows that the series (14) is divergent. Theorem 5 
is thus proved. 


Example 6. In § 68 we have considered an important class of 
‘series with constant signs of the form 


) 1 1 
fe oe ee (16) 


and proved that the series (16) converges for s > 1 and diverges for 
5s <1. Theorem 5 can be used to establish convergence of the series 
(16) directly. Assuming in theorem 5 that a = 1, f(x) = x7*, we can 
see that convergence of the series (16) is equivalent to convergence of 
the integral 


fe] 


| x8 dx, 


1 
which is convergent for s > 1 and divergent for s < l. 


Example 7. Let us now consider a more sensitive problem on 
convergence of series of the type 


2 
Laima ee 


n=2 


504 A GOURSE OF MATHEMATICAL ANALYSIS 


where s is a constant.real number. It can be readily shown that if 
5s > 0, none of the tests considered in § 68 can be used to establish con- 
vergence of series of this type. However, this problem can be readily 
solved by means of theorem 5. Let us assume that a = 2, f(x) 
=1/x (In x)* , so that convergence of the series (17) is equivalent to 
convergence of the integral 


ce 
| ae (18) 


x (In x) * 


Since 


a 


| ay f i _ {(In x)!-* — (In 2)1-9} (s 4 1), 


w(In w)s =) 
|. In In x.— In In 2 (s = 1), 


therefore the integra] (18) is convergent for s > 1 (it is equal to 
1/(s — 1)(n 2)*-1) and divergent for s < 1; hence the series (17) is 
also convergent for s > 1 and divergent for s < 1. The series 


foe) 


1 
2 ninn 


n=2 





is also divergent whereas the series 





is convergent. 


For further exercises ¢f. Problem Book by B. P. Demidovich, 
Section V, No 64. 


§ 108. Integrals of unbounded functions 


In defining the concept of an integral we have so far always. 
assumed that the integrand is bounded within the interval of integra- 
tion. We shall now introduce a wider concept of an integral which 
will enable us in certain cases to integrate unbounded functions. As. 
in § 107 we shall begin by considering a simple case. Let the 
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function f(x) be defined in the interval (0, 1) as follows : 


an 

ay Ze (0< < 1), 
fey : 

{| 90 (x = 0). 


Since 1/4/x increases indefinitely as v > 0, therefore the function: 
J (x) is not bounded in the interval (0, 1). It is discontinuous at the 
point x = 0 and continuous at all 
other points in the interval (0,1). Its 
graph is shown in fig. 67. It is 
evident that for arbitrarily small ¢ > 0. 
we can integrate the function f(x) in 
the interval (s, 1) and its integral 


1 


| so) dx -[&-eve oy hs 


€ 





—Diiws (1) | Fig. 67 


expresses the area of a curvilinear trapezium which is shaded in 
fig. 67; this area increases indefinitely as = decreases; when < — 0,. 
the shaded figure extends indefinitely upwards; however, it can be 
seen from formula (1) that the area of this figure does not increase 
indefinitely in this process but merely tends to the limit 2. We 
naturally take this limit as the area of the whole region above the 
interval (Q, 1) of the OX-axis and below the curve y = 1/+/x. This 
geometrical illustration again gives us an example of a figure which 
has a finite area although it extends to infinity. A comparison of 
fig. 67 and fig. 66 readily shows the close resemblance of the two 
pictures. 


From a purely analytical point of view we have here a case in 


which we are unable to determine the above area by means of the: 
integral 


[sa 
0 


since the integrand is unbounded in the interval (0, 1); but we 
assume that this area is equal to the limit 
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1 . ae 
lim | f(x) dx; : (z) 
e>0 
© 


:for arbitrarily small ¢ > 0, the integral 
1 
| FT (x) dx 
€ 


has a definite meaning, since the function f(x) is continuous in the 
interval of integration. 


The limit (2) is called the (generalised) integral of an unboun- 


-ded function f(x) from 0 to J (or in the interval (0, 1)) and simply 
‘denoted by 


1 
| F(x) dx ; 
0 

wwe can therefore write 


1 
a lim ie == 
4 ve ¢—>0 fx 


Let us now consider the general definition. Let the function 
(x) be defined in the interval (a, 5) and be integrable for arbitrarily 
small < > 0, (and therefore bounded) in the (a + ¢, 6) but not 
bounded in the whole interval (a2, 6). If the following limit exists in 
this case : 


b 
lim SF (x) dx, (3) 
¢->0 
ate 


then we simply call this limit the (generalised) integral of the unbounded 
function f(x) in the interval (a, 6) and denote it by 


b 
| WOU (4) 


the integral (4) is, in this case, said to be convergent ; if, however, no 


limit exists, then the integral: (4) is said to be divergent and has no 
numerical value. 
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We can thus see that this wider concept of an integral is used 
in cases when the integrand is only unbounded in the immediate 
neighbourhood of a point in the interval of integration and bounded 
-and integrable at all other points in this interval. In our example, 
as well as in the general case, one such “singularity” is the left end a 
of the interval of integration. It is, however, self-evident that this 
definition holds for every position of the “singularity” in the interval 
of integration. Thus if the function f(x) is integrable for every 
-= > 0 in the interval (a, 8 —) but not bounded in the whole interval 
(2, 6) and if the integral 


[ fore 


tends to a limit for < ~ 0, then, according to the definition, we 
. assume that : . 


[40 dx = in [63 dx; 


here the right end 64 of the interval of integration is a singularity. 
Finally if an arbitrary interior point ¢ is the singularity in the interval 
(a, 6), 7.e. if the function f(x) is integrable in each of the intervals 
(a,¢—,) and (¢+<¢,, 4) for arbitrarily small ¢, > 0 and s, > 0, 
then we simply assume that 


ste) dem [ste de + | se 


S ae 


where both integrals on the right-hand side are generalised integrals 
with a singularity ¢ at one end of the interval of integration and we 
-can therefore regard them as defined. It is self-evident that in order 
that the integra] 


b 
[se dx 


should be convergent it is here necessary and sufficient that both the 
limits 
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¢— ey 
lim [ro wa free 
e,->90 
and 
b b 
lim | f(x) dx = Jre dx 
to790 
été, e 


should exist. 


We have already drawn attention to the fact that if the inte-- 
grand is positive, the geometrical illustration of the integration of an 
unbounded function resembles the corresponding illustration for 
integrals with infinite limits as considered in § 107. It can be readily 
shown that these two problems are closely related to one another 
analytically. Let us assume, for example, that the function f (x) is 
unbounded in the neighbourhood of the left end a of the interval of” 


integration so that 


b 








b 
| f (x) dx = lim | f (x) dx. 
¢30 
a ates 
The transformation of the variable + = a + — gives 
1 1 
é 
I \d 
[re a x =|f(e+5)9= [eore, 
a+e 1 
b—a b—a 


where it is assumed that 


o) = af (a+ —). 


The relation (5) therefore gives us : 


ze—>90 


1 
| fe) dx = lim ie (x) & =|e (y) ® 
J 1 








b-a b—~—a 


(5): 
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so that the integral of an unbounded function can be transformed 
into an integral with an infinite limit simply by transforming the 
variable of integration. Asa result of this connection between the 
two new concepts of integrals the properties of integrals of the first 
type considered in § 107 correspond to analogous properties of integ- 
rals of unbounded functions. Hence all fundamental concepts in 
the theory of integrals of unbounded functions can be constructed on 
lines parallel to the fundamental concepts in the .theory of integrals 
with infinite limits as considered in § 107. The proofs of all propo- 
‘Sitions can be carried out equally by either one of two methods : 
they can be constructed in full analogy with the arguments used in 
§ 107 (which, in their turn, were mostly carried out by analogy to 
the theory of infinite series) or we can use the above method of 
‘transformation of the variable of integration and thus convert the 
_proposition to be proved into the corresponding theorem on integrals 
‘with infinite limits and then refer to the appropriate theorem. 


Here the following propositions hold, which are analogous to 
the corresponding theorems considered in § 107 (we assume in all 
-cases that the integrands are bounded and integrable in the interval 


(a + ¢, 6) for arbitrarily small « > 0 but in general not bounded in 
the whole interval (a, 4). 


Theorem Ul’. In order that the integral (4) should converge it is neces- 
sary and sufficient that for arbitrarily small ¢ > O the following inequality 
should hold for all sufficiently small 8, > 0 and 6, > 0: 


a+dée 


[sea mes 


atdy 


Theorem 2’ (Principle of comparison). [f we have 0 <f (x) <cp(x) 
fora <x <b, where c is a constant positive number, then convergence of 
the integral 


b 
[ ° (x) dx 
a 

dmpiies convergence of the integral 


b 
[fe (a 
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and the following inequality holds : 
b 


fro dx < e | ola) dhe 


a 


The integral (4) is said to be absolutely convergent provided the- 
following integral is convergent : 


b 
[ise ass (6): 


according to theorem 1’ convergence of the integral (6) implies con— 
vergence of the integral (4). 


Since the integral 


b 
| (x — a) dx, 
a 


is convergent for « < 1 and divergent for « > 1, as can be easily 
shown, the following simple test for convergence can be deduced 
from theorem 2’. 


Theorem 3’. Ifa < 1 and for every x > a sufficiently close toa the 
following inequality holds: | f(x) | < (x — a)-*, then the integral (4) is 
absolutely convergent; but, if % > 1 and for every x > a sufficiently close to ai 
we have f (x) > (x — a), then the integral (4) ts divergent. 


The more sensitive test stated by theorem 4 § 107 which en-- 
ables us sometimes to determine the non-absolute (conditional) con-- 
vergence of integrals also corresponds to an analogous test for con-- 
vergence of integrals of unbounded functions which is expressed by’ 
the following proposition. 


Theorem 4’. [fa > 0, the function p(x) ts continuous for x > a: 
and there exists a positive number C such that we have for arbitrarily smalk 
e>0 





b 
fewa 
ate 





<C 
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then the integral 


b 
[@-a¢ (x) dx 


ts convergent. 
Proof. Let us assume that 
b 
| o(x) dx = ® (un) (a<u<b), 


zd 


so that: ® (u)| < C(a <u <4). Integrating by parts we obtain :- 


Jo-o (9) de = 


=[-( =a) I)" ta [ @-gto(yae= 


tee 


ate 
b 
= <*O (a $e) +a] tae) ate (x) dx, 
ave 


since ® (6) = 0. When<z-— 0, the first term on the right-hand side- 
tends to zerosince « > Oand'® (a+ 2)| < C. The absolute value 
of the integrand of the second term is less than C / (x—a) 1~*, .where 
1—a< 1. It therefore follows from theorem 3’ that the second 
term on the right-hand side tends to the following integral as its limit 
fors > 0: 


b 
«| (x — a) 1 @ (x) dx. 


Hence, if < —> 0, the left-hand side of the last equation also has _the- 
same limit and theorem 4’ is proved. 


Example 1, Let us consider the integral 
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For every constant A > 0 the product x A In x tends to zero for 
x —» 0, as can be seen directly by applying L’ Hopital’s rule, if we - 
‘represent this product in the form of the ratio In xf’, Assuming, 
an particular, thatA = 1 / 4, we have for a sufficiently small x > 0 


1 
JInx|<wx 4, 
.and consequently 


3 
~ 4 


|inz] -, 


Vox 





Fig. 68, 


_and this, according to theorem 3’, implies absolute convergence of 
the integral J. } 


Example 2. Let us consider the integral 
1 


t= [oss 
0 


where « is an arbitrary positive number. When « is small, the 
_quantity 1 / x ?-* increases very rapidly as x > 0; and since cos 1/x 
vibrates an infinite number of times between -+ 1 and — 1 in this 
process, therefore, the integrand is strictly unbounded in the neigh- 
-bourhood of the point x = 0; the graph of this function is represen- 
:ted in fig. 68. 


GENERALISED INTEGRALS ay) 


The replacement of the variable + = 1 / » gives: 


1 


1 € 








= = Joosy a = sin + — sin 1} <2. 
: 
Therefore the function 
1 ] 
o{x) = Fe 008 5 
satisfies the requirements of theorem 4’ in the interval (0, 1). Apply- 
ing this theorem (a = 0) we find that the integral 


1 


1 
| we (x) dx = [ cos 4 a=! 
0 0 


is convergent for every « > 0. 


For further exercises cf, Problem Book by B. P. Demidovich, 
Section IV, Nos. 102, 104, 110. 


CHAPTER XXVI 
INTEGRALS OF PARAMETRIC FUNCTIONS 


§ 109. Integrals with finite limits 


The study of quantitative relations existing in the world around 
us leads to the discovery of many new kinds of functional depen- 
dencies. It is one of the main objects of mathematical analysis to 
investigate more and more classes of functions. However, a mere 
mention of the types of functions in existence would, of course, be quite 
insufficient ; we must define such families and develop methods for 
their study, for otherwise the newly discovered functions would be 
quite useless: functions and properties of functions which we cannot 
study are useless to us. ‘Therefore, for the study of new unknown 
functional dependencies science always tries to provide an instrument 
which enables us to deal with these functions systematically and 
develop their main properties gradually. 


Our studies so far are rich in examples illustrating these points. 
The sum of an infinite series of functions whose terms are composed 
of well-known functions (for example, power and trigonometrical) is, 
generally speaking, a new function whose properties we hardly know; 
but the series which defines it usually appears to be a strong and 
convenient tool for the study of its main outlines (for example, for its 
evaluation and definition of the results of operations performed on it). 
We are already familiar with the useful properties of infinite series 
and the close connection existing between the properties of the series 
and functions. Integral calculus provides an even more instructive 
example. We know that a whole family of primitives exists for every 
continuous function and even for simple (elementary) functions these 
primitives are usually new functions about which we know nothing 
except that they are differentiable and their derivatives are equal to 


514 
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known functions. It is therefore self-evident that finding the primi- 
tives is a useful source for the definition of new functions; however, 
this definition is by itself almost useless, for although we know about 
an “integral logarithm” that its derivative is equal to 1 / Inx, this 
tells us nothing about the properties of this function and we also have 
no method for evaluation of the integral logarithm. How do we 
overcome this obstacle ? We make a superior apparatus (integral) 
which enables us to find primitives of the given functions; we give, as 
it were, constructive definition to primitives, i.e. we define the functions 
by means of an instrument which proves to be very convenient for 
studying the properties of functions (and which, in principle, enables 
us to evaluate these functions with any desired degree of accuracy) ; 
and historically too, integral calculus only became a convenient 
method for studying new classes of functional dependencies after this 
apparatus was created. 


In this chapter we shall learn a new method for defining and 
studying functions; historically it is one of the most productive 
methods, for it enables us to study in detail many functional depen- 
dencies which are of the greatest importance in theory and many 
diverse applications. 


Let the function f(x, u) continuous in the rectangle R(a <x < 4, 
a <u <8) be a function of two independent variables. Let us 
choose and fix definite value of the variable u in the interval (a, 8); 
f(x, u) thus becomes a continuous function of one variable x in the. 
interval (a, 6); the integral 


b 


[fe u) dx 


a 


of this function depends in general on the chosen value of the variable 
u; it has a definite value for every choice of u and usually changes 
when u changes; it is therefore a function of « defined in the interval 
(«, B) ; let us denote it by 9(u) so that 


ii\ 


b ‘ 
oy = [f(s wdx  (w <u <9), (1) 


The variable x on which the integrand depends but which is 
assumed to be constant during integration (having been given a 
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definite fixed value) is usually called a parameter; the value of the 
integral depends on the chosen value of the parameter ; the integrand 
can, in some cases, evidently depend on a whole series. of parameters. 
Wy, Way «+ Up in that case the integral 


b 
ed (4, Yas wes uy ) = [ ro, Uy, Ua, +5 U ,) ax (2) 
a 


is a function of the whole set of these parameters, 
Example. We have learnt in § 66 that 


e* (y sin ux + t COS vx) 


u*—-+ y? 





| e® cos uxdx = +C; 


we can therefore obtain 





1 
e’® cos unde = e* (usin v + ¥ Cos v) — 4, 
oS u? + y® j 

0 


the integral on the left-hnad side of this equation is a function of two 
parameters wand v; the right-hand side gives us an elementary 
expression for this function. 


In the above example the integral depending on the parame- 
ters z and v is an elementary function of these parameters. However,, 
in most cases an integral of the type (2), even when / (x, uy, uz... , Uy) 
is an elementary function of its constituent variables, is a non-elementary 
fuaction, for whose study we have no other means except the integral. 
(2) itself. *~Hence we must study the properties of the function ? only 
with the help of (2); even this function can only be evaluated by- 
means of the integral itself. It is therefore obvious that the proper- 
ties of these integrals and the rules for analytical operations with. 
them require careful study, to which the rest of this chapter is. 
devoted. 


For the sake of simplicity we shall only consider integrals of 
the type (1) which depend on one parameter only, although our 
arguments and results can be extended without difficulties to include 
the general case of integrals of the type (2). 


Theorem 1. If the function f (x, u) is continuous in the rectangle 
R(agxQb,a Qu <B), then the function 9 (u), defined by the integral 
(1), as continuous in the interval (a, B). 
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Proof. If the point x and u-+ Az lie in the interval (a, 8) ; 
then 


b 
aut an) — 2) = [If Gut an —f(, olds 
and therefore 


b 
|? (u + Au) — P (u) | <fis@ut Au) — f(x, a} dx. (3) 


But it follows from theorem 3 § 88 that the function / (x,v) is uniform- 
ly continuous in the rectangle R; therefore there exists a 5 > 0 for 
arbitrarily small < > 0 for all points (x, %), (x2, %,:) of this rectangle 
which are at a distance less than 8 

| f (xe. us) — f (x, %4) | <¢. 
Since the distance of the points (x, u) and (x, u + Ax) is equal to 
| au|, therefore, we have for | Au| < 8 


\f(x,u + au) — f(x, u) | <e, 
whatever the points (x, u ,x, u + Au) of the rectangle R. Thus for 
| Au| < 8 on account of (3) we have 
lout Av) - Plu) |<ec(b—a) («Ruut Aus); 
Since ¢ > 0 can be chosen as small as we please, we have therefore 
theorem } is proved. 
Having thus established continuity of the integral (1) with res- 


pect to the parameter uw we can now integrate the function ? (1) in 
the interval («#, 8) (or in any subinterval). The integral 


fe (u) du = (ffs (x, u) dx dit (4) 


always has a definite meaning (provided the function / (x, u) is conti- 
nuous in the region R). We know that for series of functions (§ 75) 
“term-by-term” integration is of greatimportance, 7.¢. we can inte- 
grate under the summation sign; similarly for functions of the type 
(1) it is most important to integrate with respect to u under the sign of 
integral with respect to x; the question therefore arises, whether the 
integral (4) will coincide with the integral 


6 3 
[i fre. u) du dx, 


L 
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which differs from it only by the order in which the integrations are 
performed. Let us note that term-by-term integrability of the series 
of functions 


a 


yi Ux (x) 


k=1 


in the interval (a, 6) depends on whether the equation 


Dee co 4b 
[id (9) { ds = Yh [mca f, 


k=1 k=1 a 


holds, i.e. the interchange of the order of summation with respect to k 
and integration with respect to x. Similarly the ability to integrate 
the function 9 (u) with respect to u under the integral with respect to 
x is equivalent to the independence of the result of successsive inte- 
gration of the function / (x, w) with respect to x and uw from the order 
in which these operations are carried out. We will now show that 
this problem can always be solved positively for continuous functions. 


Theorem 2. Jf the function f (x, u) is continuous in the rectangle R, 


then . - 
Je Gy ie [Afr as pies [fre ui) de ds 


Proof. Leta <a’ <6’ <b«<e’ <’ <B and let m and 
M denote respectively the lower and upper bounds of the function 
f (x, uw) in the rectangle (a’ <x <b,’ Cu <<’). We therefore 
have fora’ <u < 8’ 
b! e 
m(by—ay< [pede <M (h' — a) 


and integrating from «’ to fp’ 


B’ bh’ 
m(b —a'y{p' —“)< [} [re u) dx tl <— 
a’ a’ 
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Similarly we find that we also have 
b' iM 


m(b' — a) (ps —a’) < [} [re u) au ds = 


< M (b' — a’) (8° — @’). (6) 


Let us now divide the interval (a, 5) into n subintervals by 
means of the following points of division ; 


Cay OR, Se Ss oy — 
and the interval («, 8) into m subintervals by means of the following 
points of divison : 

= ty ay Sg ee Sg = E. 
Let us denote by Aix = (*i — %i-1)(UZ — Up-1) the area of the rect- 
angle xj-3 <* < xi, My-y Ku < uy and by my, and M,, respectively 


the upper and lower bounds of the function f(x, u) in this rectangle. 
Applying the inequalities (5) and (6) to this rectangle we obtairt 


uy XG 
Mix Ain X | | FAK W) ast du < Min Aix (7) 
Mpy X42 


Min Ain BS i i Bag ice u) an} ds < Mi A ix (8) 
Xi. Mp 


(lsicgn, 1 Sk gm) 


We now note that 


al | RES jon f {3 ic (% ids du= 


mo My, 


-y y FSP sos wax hae, 


i=] k=] ity ¥ 7-1 
and similarly 


b 6 


=| { tf (*% n)du a) y i { Rees udu { de 


a a tL A= 1 xy Up 
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Applying the inequalties (7) and (8) respectively to all terms of the 
double sums of these equations we obtain: 


n m rmoem 
, a8 Min Air: </fi< y} Mu A ies 


i=1 k=1 i=] k=1 

nom nom 

} » Miz bike &LI'< > yMa, Ain: 
i=1k=) t=} k=] 


Hence the integrals J and J’ whose equality we must prove are 
both confined between these two limits; the absolute value of the 
difference J—J' therefore cannot exceed the distance between these 
two limits, 2.e. 


tu m 


IZ-11<)) Vita — mi) awe 
i=1k=1 


-If the above divisons of the intervals (a, 6) and («, 8) are suffi- 
ciently fine (and there is no reason why we should not make them 
as fine as possible), then uniform continuity of the function f(x, u) in 
the rectangle R implies that all the differences Mj, — mi, (1 <i <n, 
1 <k <m) will be less than an arbitrary preassigned positive num- 
ber ce. Therefore 


n m 
I-1', <e Ph Van =e — ap — 2). 


Since « > 0 is as small as we please and the left-hand side is indepen- 
dent of ¢, therefore 7 = I’ and theorem 2 is proved. 


We shall now consider differentiability of the function 9 (1) 
given by the integral (1). Just asin term-by-term differentiation of 
infinite series we are here concerned with differentiability of the 
function 9 (wz) in the interval (%, 8) and possibility of expressing its 
derivative in the form 


b 


Of (x, wo. 
au dx, 


a 


or, asit is usually said, with “differentiation under the sign of the 
integral”. If differentiability of the terms of the series was a neces- 
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sary condition, so now we must also assume existence and continuity 
(or at least integrability with respect to x) of the the partial derivative 
-Of / Quin the rectangle R: However, this assumption is also sufficient 
-as can be seen from the following theorem. 


Theorem 3. Jf the function f{x, u) and its partial derivative 
Of (x, u) | Ou are continuous in the rectangle R, then the function 9 (u), given 
by the interval (1), ts differentiable in the interval (x, 2) and 
b a 
tu) = [AL as (a <u <8). (9) 
oO [ 
a 


Proof. Let us assume that 
b 
[2 ae = a (2 Su <f). 
a 
It follows from theorem 2 that fore <v < 8 
b 


oe 
(udu = | [ ee a) au dx = 
ou 


a 


R ey 


6 
= | { f(x, v) — f(x, a} dv = ofv) — oa). 


The left-hand side of this inequality which is an integral of a conti- 
nuous function is integrable with respect to the upper limit v and 
its derivative is equal to g(v) (theorem 1 § 50); therefore 9’ (v) exists 
and is equal to g(v) for every v(z2 <v <8). Theorem 3 is thus 
proved. 


We have assumed in all that is said above that the limits a 
and 6 of the integral (1) are constant. However, it often happens 
in practice that we integrate within different limits for different 
values of the parameter u so that @ and 6 become functions of the 
parameter u: a =a (u), b = 6 (uw). Evidently such an integral 

b (u) 
Sa) =| f(s, w) de (10 
a (ux) 


‘like the integra! (1), is a function of the parameter uw. 
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We shall now consider some properties of this more general 
dependency of the integral on the parameter. We shall always 
assume in such cases that the function f(x, u) is continuous in the 
rectangle R and the functions a(u) and 6(u) are continuous in the 
interval («, 8) where 


asa(u) <b, axb(u)<ob (0 <u <8). 


It can be shown that the function ¥ (uz) is continuous in the interval 
(«, 8). In fact, ifu and uw + A uw lie in this interval, then 


b(u+ Ax) b (u) 
v (ut Au) —d (a) = i Silaju+ Au) dx — | foro dx. 
a(u + Au) a (u) 
Since . 
b(u+ An) 
| S(x,u + Au) dx = 
a(u+ Ax) 
a (2) b (u) 
= | f(x,u + Au) dy + | SJ (x, + Au) dx + 
a(u-+ Aw) a (zu) 
b(u t+ Aw) 
+ ie (x, u + Au) dx, 
b (u) 
therefore 


a (u) 
y(u+ Au) —v(u) = | S(x,u + Aw dx + 


a(ut Aw) 
b(ut Aw) b (u) 
+ | S (x, u+ Au) ax + | (f(x,u+ aA u) —f (x, u)] dx. (12). 
b (u) a (u) 


When Au — 0, the limits of the last integral on the right-hand 
side remain constant; the argument used for deducing theorem 1 
therefore shows that it tends to zero. The absolute values of the - 
first two integrals are evidently less than 


Mj\a(u+t Au) —a(u)|, Mlb (w+ Au) — 3b (u)| 
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(where M is the upper bound of the function | f(x,y) | in the rect- 
angle R) and it therefore follows from the assumed continuity that 
the functions a («) and 6 (uz) also tend to zero as Au > 0. 

Hence 


vit Au) —vU(u>O0 (Au>O0) («2 cu <6), 


and thus the function (uz) is continuous in the interval (a, 6) ; the 
following generalisation of theorem | therefore holds : 


Theorem 4. Jf the function f (x, u) is continuous in the rectangle R- 
and the functions a (u) and b (ut) are continuous in the interval (¢, B), where 


aca(u) <b, ax<b(u) <b (x <u < 8B), 


then the function U(u), given by the integral (10), is continuous in the 
interval (a, B). 


We will now assume that the functions @ (uw) and 6 (w) are not 
only continuous but also differentiable in the interval (%, 8) and 
the function / (x. u) has a continuous partial derivative ¢f / du inthe 
rectangle R; we will show that the function ¢ (z) is in this case. 
differentiable in the interval (a, 6) and y’(w) can be expressed by a. 
simple formula which is the direct generalisation of formula (9). 


We have : 
b(u+ Au) b (u) 
but ano =| feet and—| feddr= 
alut+t A x) a (u) 
b (wu) b (w) 
= } { F(x, u-+ Au) dx -| F(x, ude § -+- 
a (u) a (u) 
5(u+ Aw) alu+ Au) 
+[ fosut aw ds — | flu t addr (12). 
b (u) a (u) 


We will consider u as constant and assume that 
b (x) 
c= | fle odde (4 <0 < §). 
a {u) 
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According to theorem 3 the function 9 (v) is differentiable in the 
interval («, 8) and 


(u) 
ym [BLE a (oo 8) 
a (u) 


in particular, when v = 4, 


b (u) 
OF (x, u) dx = o'(u) = lim gut Av — @ (w) = 
ou Au >0 Au 
a (u) 
b (u) 
= lim . sit fre u-+ Au) dx — [fsa dx t (13) 
Auro AY ae 


This shows that the first term on the right-hand side of the equations 
(12) if divided by Au tends to the following integral as its limit for 
Au— 0: 


Let us now consider the second term. According to the mean-value 
theorem 


b(ut A wv) 


| so, w+ Au) dx =f(2,u+ au) [b(u + Au) — 6b (u)], 
b (u) 


where & is confined between b (u) and 6 (u + Au). Therefore 


b (ut Au) 
b — b 
re [ fe t+ Au) dx = =fGut ay Stan hw 
b (uy 


When Au -> 0, the second factor on the right-hand side tends to 
5" (u). However, in the first factor u + Au— u,%— b (u) and it 
therefore follows from continuity of the function f (x, u) that 


FE,u + Au) > f [b (u), u). 
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Therefore 
; but Ax) 
lim — | S(,u+t+ Au) dx = f[d (u), vu] b'(u). (14) 
Au oAt Bw) 


We have similarly 
atu+ Aw) 
Kae ae u-+ Au) dx = f[a (u), uj a’(u). (15) 
atu 


Finally taking into consideration the results (13), (14), (15) we 
obtain from the equation (12) : 


vu + Au) — 9 (u)_ 





lim 

Au—>0 Au 
b (u) 
-| ai ed FG al BN Plea al Bw 
a (u) 


We have thus proved differentiability of the function  (u) at 
the point w and found an expression for the derivative )’ (wu). The 
result can be expressed by the following proposition. 


Theorem 5. Jf the function f(x, u) ts continuous in the rectangle R 
and if it has a continuous partial derivative with respect to u and the functions 
a(u) and b(u) are differentiable in the interval (a, 2) and 


au) <b, agb(u <b («<u <8), 


then the function U(u), given by the integral (10), is differentiable in the 
interval (a, &) and 


b(u) 
UGA | ad dx + f [b(u), u] b'(u) — f[a(u), u] a’ (u). (16) 
- a) 


“ In particular, if a(v) and 6(u) are constant in the interval («, 8) 
we have a’ (u) = 6'(«) = O and formula (16) becomes formula (9) of 
theorem 3. 


For exercises, cf. Problem Book by B.P. Demidovich, Section . 
VII, Nos. 17, 18, 23. 


526 A COURSE OF MATHEMATICAL ANALYSIS 
§ 110. Integrals with infinite limits 


In the last paragraph we have considered integrals with finite 
limits which depended on parameters and shown the analogy 
between problems and arguments in this field and corresponding 
problems in the theory of infinite series. However, this analogy only 
becomes fully apparent by studying integrals with infinite limits 
which depend on parameters, 7.e. by studying integrals of the type 


[ re. u) dx (i) 


(as in chapter 25, we shall restrict ourselves to: the consideration of 
integrals with infinite upper limits; it is needless to say that all pro- 
perties of these integrals can be symmetrically extended to integrals 
with infinite dower limits and, subsequently, to integrals with both 
limits infinite). As we shall see, the theory of these integrals serves 
as the basis for the deduction of many important classical analytical 
formulae which we shall study in this paragraph. 


Let us assume that the integral (1) is convergent for all values 
of the parameter u in the interval a <u <f. It is therefore a func- 
tion of the parameter u defined in the interval (a, 8): 


[ so, u) dx = ? (u). (2) 


We know from the theory of series of functions (chapter 19) 
that the concept to uniform convergence is of fundamental importance 
for these series ; for integrals of the type (1) the analogous concept is 
equally important. If the integral (1) is convergent at any arbitrary 
point w in the interval («, 6), then for every ¢ > 0 and for every 
point u in («, 6) a number A, can be found (which depends on ¢ and 
u) such that for every A > Ay 


| ie uy dx: <<, (3) 

A | ; 
For a given < the number jy will, in general, be different for different 
values of u. If for every ¢ > O there exists an Ay such that for A > Ay the 
inequality (3) holds for every ula <u <8), we say that the integral (1) is 
.uniformly convergent in (a, B). 
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Example, Let us consider the integral 
ioe) 
Le = | ee ar dx, 
0 


where « > 0. We have seen at the end of § 66 that 


dees Bega CONG SOR — 0 COS Ds) ow 2. 
i em sin bxdx = ~— e@ik = tC, 





where a and # are arbitrary constants. In particular, 


; — e- "(x sin x + cos x) ' 

| e~*® sin x dx = ee age ie Dx (x) a C, 
where the function ®,(x) evidently remains bounded for x > 0, 
fed > 0: 


| Dy (x) |< B (x > 0,4 > 0), 


where B is a constant. Integrating by parts we therefore obtain for 
a Oe * 


x x | 


| pnt sin * ae [ (x) i =f |~ Ao) ie < 
: a a xe 
a a 


1 
| a 


od, ; "DM, (x) | 
es Ol ge 
NX a 
a 


‘Since the right-hand side is independent of « and tends to zero as 
a» oo, therefore the integral J(«) is uniformly convergent with 
respect to the parameter « in the semi-straight line « > 0. 


For this class of integrals the concept of uniform convergence is 
just as important as for series of functions. We shall soon confirm 
this by a series of propositions each of which corresponds to an 
analogous theorem in chapter 19. 


*) Formulae for integration by parts can be applied to integrals with infinite 
limits only when both constituent integrals are convergent (in such cases the term 
free of integrals must tend to a definite limit when the independent variable 
increases indefinitely}. This can be shown directly by writing the formula for a 
finite interval of integration (a, 6) and assuming subsequently that 8 increases 
indefinitely. 
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We shall at first consider a simple and convenient test for 


convergence which is analogous to theorem 2 § 73: 


Test for uniform convergence. Jf a continuous function F(x) 
exists such that \ f (x, u)) < F(x) for all sufficiently large values of u in the- 
interval (a, 8) and if the integral 


i F(x) dv 


is convergent, then the integral (2) is uniformly convergent in the interval’ 
(, 8). 
The proof is analogous to that of theorem 2 § 73 and based om 


the inequalities 


B 


B 
| Fe. u) dx! <| | flx,u fdr < 
A fl 


F(x) dx, 


eee by 


which hold for a sufficiently large A and B > <I, 


In the same way as uniform convergence ofa series of conti-- 
nuous functions guarantees continuity of its sum (theorem 1 § 74), so 
uniform convergence of the integral (2) (when the function /(x, u) is 
continuous) implies continuity of the function of the parameter z 
which it expresses. 


Theorem 1. [f the function f (x,u) is continuous fora<«, «<u <f,. 
and the integral (2) ts uniformly convergent in the interval (a, B), then the- 
function 9(u) is continuous in that interval. 


The proof is analogous to that of theorem 1 § 74. Let ¢ > 0: 
be as small as we please; let us close Ay so large that A, > a and 


{ f(a, w) dx | <x (x <u < 8B). (4) 
Ao 


Since, according to theorem | § 109, the integral 


Ay 
[re u) dx 
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is a continuous function of wu in the interval (a, 8) therefore for a 
sufficiently small | Ax | 


Ao Ay 
|] £0 iiaae thc )de. <q. (5) 
But 
Ag 


o(u+- Au) — $(u) = \ J res, wt Al ) dx — fe u) dx + 


+ | S(x,udt- Au) dx — | I (w, u) dx, 
Ag 


Ag 


it therefore follows from (4) and (5) that when | Ax | is sufficiently 
small 


0 Ag 
lp(u+ Ax)—o9(u) | S| [ se. wt anldr—| f(s, u)dx ++ 


-+ || ft ut Aujde | + | fr x , ud: gi yo ee 3 =e 
Ag 


Theorem | is thus proved. 


Uniform convergence of the integral (2) which is a sufficicnt 
condition for continuity of the function ¢(uz) is not, howcvcr, the 
necessary condition for this purpose; the position is just as with series, 
There is one important particular case, however, whcn it is also the 
necessary condition; we have the following proposition which is ana- 
logous to theorem 2 § 74. 


Theorem 2. If f(x, u) ts continuous and has a constant sign in the 
region x > a,a <u < B, then continuaty of the function P (u) in the interval 
(a, 8) zmplies uniform convergence of the integral (2). 


Proof. Let us assume, say, that f(x, u) >0 (v >a, a <x <8). 
Let wu, be an arbitrary point in the interval («, 8). Since the integral 
(2) is convergent at the point uo, therefore for arbitrarily small <> 0 
a number A, exists such that 
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ac Ug)dx <3 (6) 
Ag 


where the number dy depends on the chosen point %; but since, 

according to our assumptions, the function ? (uw) is continuous in the 

interval (x, 6) and it also follows from theorem | § 109 that the func- 
Ao 

tion [ro u)dx is continuous in that same interval, therefore the 


a 


function 
& Ag 
[t6. u)dx = o(u) — [re uy dx 
Ao i 


is also continuous in («, 8); hence the inequality (6) which is satisfied 
at the point 29 must also be satisfied in a neighbourhood of that point. 
Therefore every point in the interval («, 3) also lies in an interval 
all points of which satisfy the inequality (6). The set of all subinter- 
vals constructed for all the points wu) in the intervals («, 8) covers 
entirely the interval («, 8). In accordance with the lemma on finite 
coverage a finite group 6), 5,,...,65, of subintervals of this system 
exists which also covers the entire interval (a, 8). Each subinterval 
8: (1 <7 <n) corresponds to a number 4; so that 


[ se. uldx <e 
A; 


for all the points win the subinterval 6;. Let A be the greatest of 
the numbers d4,, Ao, -., dn; it then follows from the condition 
fix, u) > OW Saaegqu <8) that: 


[ f0 ubdx <e 
A 


for all the points w in any one of the subintervals § ; and, consequently, 
also for all points win the interval («, 8) since this interval is covered 
by the system of subintervals 5,,3.4,...,5,. And since « > 0 is 
arbitrarily small therefore the integral 
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[ S (x, w) dx 


is uniformly convergent in the interval («, 8). Theorem 2 is thus 


proved. 
Moreover, just as for the term-by-term integration of uniformly 


convergent series of functions the following proposition holds : 
Theorem 3. Under the conditions stated in theorem 1 we haze 
ces) 


| g{u)du = | fre wt) du fas. 


a a a 
In other words, under the given conditions an interchange of 


integration with respect to x and uw is permissible: 


if [46 u) dx du == if fae wu) du dx, 


«a 
2 $109 can be 


i.e. in the case of uniform convergence theorem 


extended to include the case b = + ©. 


Froof. Let the number 4, > a be so great that for A > A, 


u < f). (7) 


A Boe 
feta [if toe jae] i] Sls why | a 


But it follows from theorem 2 § 109 
B A A 
(tf S (x, u) dx fa =|} | J (x, u) du bas, 
a a a 


a 
and as a result of the evaluation (7) the above equation gives: 


6 A 6 
|| eeran = | | f(e, udu x < (8 — a) 


a 


a 
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provided only 4 > A,; but this means that the integral 


if se t) du a 


ea 


8 
is convergent and equal to { ea Theorem 3 is thus proved. 


[od 


In the above two integrations whose order can, in accordance 
with theorem 3, be reversed, we have only one infinite limit whereas 
the other limit is finite. In practice the following much more compli- 
cated case is of greater interest, z.e. when the limits of both integrals 
are infinite. A typical example of this type is held in the question, 
under which conditions we have 


fos] 


| 7 uve la = ir il Kew ax | ih: (8) 


a 


In this book we cannot consider this problem thoroughly. We shall 
restrict ourselves to the investigation of a particular case which will 
be found useful later and whose conditions are suitable for deducing 
tests which would make the transposition (8) possible ; we shall assume 
that the function f(x, u) has a constant sign in the whole region x > a, 
u > «3; we shall assume, say, that it is non-negative. In that case 
the following theorem holds: 


Theorem 4. If the function f(x, u) > O ts continuous in the region 
x > a,u > « and if the functions * , 


foo} 


ctu = | 


are respestivaly continuous for u > « and x > a and out of the integrals 


fds, ¥(x) = | fdu (9) 


loo) 


| pera, f ewe 


a 


at least one ts convergent, then the other ts also convergent and the two integrals 
are equal to one another i.e. the equation (8) holds. 


*) Here and in future we shall write f instead cf f (x, y) to simplify notation. 
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Proof. Let us note that as a result of theorem 2, the assumed 
continuity of the functions 9 (u) and ¢ (x) implies uniform convergence 
of both the integrals (9)—the first is uniformly convergent in thearbi- 
trary finite interval « < u <8 and the second in the arbitrary interval 
a<x <b. Let us assume that the following integral is convergent 


oO 


[s (x) dx = 1; 


a 
we must therefore prove that the integral 


ig 


[ @@)du 
a 
tends to J as 8 -> o, or, as a result of theorem 3 
6 B 2 ae 
[oadu= [ff sae bau ff | pau fas 
x a a a io 
so that 
mt) JB 
lim | | faut dr = 1 (10) 


B—> oo 
a 


Let « bean arbitrary positive number. The assumed conver- 
gence of the integral 


fe (x) dx 


implies existence of a number 4 > a so that 


eo 


feoer= ff fre bax <e, 
b b 


a 


and, therefore, as a result of f(x, u) > 0 we also have for every Ce 


fra has <e: (11) 
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Let us now choose the number 86 so large that 





b—a 


[rau < (a<x<b) 
B 


(we can do this, since the second of the integrals (9) is convergent in 
the interval (a <« < 6)). In this case 


[fra dec. a 
a 8 


Adding the inequalities (11) and (12) we have: 
[jl saeh as < 2e, 
a 8 
or, which is the same 
o 8 


r= [hf pau hae <2¢, 


a x 


provided 8 is sufficiently large. Since cis arbitrary, this proves the 
relation (10) and therefore also theorem 4. 


Let us finally consider differentiability of the function ¢ (uz), 
given by the integral (2), under the sign of the integral, z.e. under 
what conditions is the function ¢ (u) differentiable and 


ie [24 dx (a <u <8). (13) 


The following proposition holds here, which is analogous to the 
corresponding theorem on term-by-term differentiation of series of 
functions (theorem 3 § 75): 


Theorem. 5. If in the regionx > a,agu < B the function f (x, u) 
is continuous and has a continuous partial derivative 0 f (x, u) | du and if 
the integral ~ 


[ee oy 5 (14) 
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ws untformly convergent in the interval (a, ), then the function @ (u), given bp 
the integral (2), ts differentiable in that interval and the relation (13) holds. 


Let us assume that for every natural number n > a 


Pn (u) _ [so u) dx, 


so that we have for n > oo: 
Pnlu) > (x) {a <u <8). 


According to theorem 3 $ 109 the function ¢, (w) is differentiable in 
the interval («, 8) and 


af (x, u) is 


On (u) = yh vs 


a 


uniform convergence of the integral (14) in the interval («, 3) there- 
fore shows that we have uniformly in that interval 


€'n (u) > | Of am) dx (n> o). 


It follows from theorem 3 § 75 that the derivative 9’ (w) exists in the 


interval (a, B) and coincides with the integral (14), which was to be 
shown. , 


Note, Out of all generalised integrals which depend on parame- 
ters we have only considered integrals with infinite limits. However, 
all that we have proved above also holds and is proved by exactly 
the same methods for the second type of generalised integrals, 2.e. for 
integrals of unbounded functions; within the scope of this book we 
are not even able to state the corresponding theorems; however, 
there is hardly any need since the analogy is so close that every argu- 
ment can almost automatically be extended from one case to the 
other. The reader should find it very useful to define by himself all 
concepts and statements and give detailed proofs of all theorems for 
integrals of unbounded functions given in this paragraph. 


§ 111. Examples 


In §§ 109 and 110 we have dealt with the theory of integrals 
which depend on parameters and find many applications in analysis. 
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In the next two paragraphs we shall consider several examples of 
these applications. It frequently happens that we are given an inte- 
gral which does not contain parameters but in order to evaluate it is 
usually simplest to consider this integral in conjunction with other 
integrals which depend on parameters and use the properties of the 
latter to evaluate the former. We shall consider several examples of 
this kind in this paragraph. 


Example 1. Evaluate 





]1—e- 
1 = {- 7 Cos Edt. . 
0 


Let us consider the more general integral 
ao 
{ — eo 
I (a) =| “cost dt, 
0 
where A is an arbitrary non-negative number so that 
T= I (1); 
we shall show that the integral / (A) is uniformly convergent with 
respect to A in the interval O << A <1. The integration in any 
finite interval (0, a), for example in the interval (0, 1) causes no diffi- 


culties since as a result of O < 1 — e-* < Az, the integrand remains 
uniformly bounded fori > O0ifO <A <1. 


We must therefore prove that the integral 


is uniformly convergent with respect to A in the intervalO <A <1. 
But this follows directly from the fact that 1) the integral 


is convergent (§ 107) and is independent of A and 2) the integral 


fee) 


| pees 
t 
l 
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is uniformly convergent on the semi-axis A > 0; the latter is similarly 
proved for the example of the integral considered in § 110 


[ema (A > 0). 
0 


Hence the integral / (A) is uniformly convergent in the interval 
0 <A <1 and is therefore a continuous function of A in that interval. 
In particular, when A — 0 


I(A) > 1 (0) = 0, 
we shall find this useful later. 


Let us denote by f(t, A) the integrand of the integral J (A). 
Since 


asta) _ e~* cos f, 
oA 





therefore the integral 


af (t, A) 
a 
0 


is uniformly convergent in the interval A / 2, 2A) for every A > 0; 
therefore I’ (A) exists for every A > 0 and 


PARC ee | cos ¢ dt (A > 0) 
0 


as a result of theorem 5§ 110. But we know that the function 
e?* cos t (§ 66) has a primitive 
e~™ (sin ¢ — A cos ¢) 
1+ 





which tends to zero as ¢—> co. ‘Therefore for every A > 0 
e~*(sint — Acost)*_ A 


1+ o  1+2% 





Te 


and, consequently, since J (0) = 0 
nN 


Xx 
La) = 1) ~ 10) = fr G) de = [pg ev tin 4), 
0 0 
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hence also 
I=J(1) =4)n2. 


Example 2. In § 107 we have proved convergence of the inte- 
gral 





we shall now try to evaluate it. 


The integral considered in § 110 


becomes J when « = (; we have seen in § 110 that the integral J (a) 
is uniformly convergent on the whole semi-straight line « > 0; it 
follows from theorem 1 § 110 that the function J («) is therefore con- 
tinuous for « > 0; in particular, 
IT=J(0)= lim / (a). 
e—>+0 

On the other hand, differentiation of the integral J («) with respect 
to « under the sign of the integral gives us the integral 


wo 
= | e~*? sin x dx, 


which, as can readily be seen, is uniformly convergent for « > < and 
for arbitrarily smalle > 0 as a result of the test in § 110 (since 
[e-** sin x] <e-e*). It therefore follows from theorem 5 § 110 that 
I’ (a) exists for a > O and 


, F 1 
=—- —ar " ad 
I’ (a) iz sin x dx 1+ 02 
0 
(the last equation is established directly, since the primitive Pg (x) is 
known (cf. § 110). Taking into account that J (#) > 0 as a— o 
this gives on integration: *) 





: sin x 
*) Since a 








oO 
<1, therefore! J (a) | < aes dx = = 4 
0 
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d 
—I(«) = —- 1 Tay! = ~= L arctan «, 
J 2 
and therefore in the limit for « —> 0 
IT = IT = ie < 
(0) ae 


hence 


and our problem is solved. 


Moreover, noting that integration by parts gives for a > 0 





a a 
sin x 1 — cosx:* i — cos x 
SL ee ces 
| oo Xx ot | x q 
0 
and that 
lim | = cos ¥ =) 0 
x30 Xx a: 


we obtain in the limit for a > 00 


I — cos x Te 
——_,— dx = -5. 
{ x 2 
0 
The latter is a very important formula of integral calculus; in con- 
trast to the preceding integral this integral is evidently absolutely con- 
vergent. 


Let us make one more remark. If « > 0, the change of the 
variable z = x / @ gives: 





[vo] foo} 
sin % in x wt 
Fee dew fF ee eB 
Zz x 2 
0 0 
if « < 0 the replacement z = — x/ « gives 
[Sees a= — [9X de = — 5 
Zz 2 
C 0 
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hence the integral 


sin “2 
T@) = |r a, 
(2) ( zg . 


(« < 0), 


(% = Q). 


which plays an important part in many applications of integral 
calculus (for example in the theory of probability and mathematical 
statistics). ‘The replacement of the variable x = ut (where u > 0 is 
a constant) gives : 


Yan a ee ha (ua o> 0}. 


oS »8 


Let us assume that for u > 0,< > 0 








Ff (u, t) = uenv? 1442), 
4 (w) = [re t) di = e7* | ue vt? dg = Te-*, (1) 
0 0 
= =—,;- L —u2 (14f2) _ ee 
te (2) [y (u, t)du= Tarai , =o 
€ 


The function ¢ (wz) is continuous in the interval (c, oc) and the func- 
tion te (¢) in the interval (0, 00). The integral 


| © (u) du = if e-" du, 
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is evidently convergent. It therefore follows from theorem 4 § 110 


j o (u) du = fv (t) de, | (3) 
E 0 


Let us take the limit of this equation forse > 0. Asa result of (1) 
the left-hand side is equal to 


I | e—¥ du, 


. .d it tends to J* ase -—> 0. In order to find the limit of the right- 
hand side we note that ¢ > 0 fore > 0 and, from (2), 
an ch Meee nes 
be (t) ==. (k a ry > 
since the integral 


a 
2(L + 2) 
0 


is convergent, therefore, on the basis of the test in § 110, the integral 
on the right-hand side of the equation (3) is uniformly convergent in 
the region « > 0 and is therefore a continuous function of « in that 
region; in particular, its limit for « -> 0 is equal to its value ate = 0 
i.e. it is equal to 


> 


i eS ore (gene 
2 (1 7 ‘0 4° 


We therefore obtain: 


7 1 
2— __ = 
rf 4° i 7 VS 


and our problem is solved. 


§ 112. Euler’s integrals 
Euler’s integrals are integrals 


1 


B(p, g) = | #1. — a) tay 
U 
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(integral of the first type) and 


LG) = [xn e~* dx 
0 


(integral of the second type) *). The first integral is a function of 
two parameters pand q and the second a function of one parameter 5. 
Both integrals define important non-elementary funtions which are 
important in various applications. Their properties were therefore 
studied extensively; detailed tables were also composed for them. 
In this paragraph we shall study some of the simple properties of 
these functions. 


1. Naturally both integrals only define the corrosponding 
functions for those values of the parameters for which they are conver- 
gent. We must therefore begin by finding the regions of convergence 
for these integrals (ze. the sets of values of the parameters for which 
they are convergent). In the integral B(p, g) the integrand is conti- 
. nuous in the whole interval of integration when p > 1, g > | and 
there is no doubt as to the existence of the integral. But, when p < 1, 
the integrand evidently becomes unbounded in the neighbourhood 
of the point x = 0; when g < 1, the same takes piace in the neigh- 
bourhood of the point x = ]. When p < 1, we have (1 — x)? 1 
as x —> 0 irrespective of g and therefore 


EA tee eat ead (x > 0). 


It follows from theorem 3’ § 108 that the integral B(p, g) will 
be divergent for p <0 (p -1< —1); if, however, p > 0 (p—1>—1), 
then the behaviour of the integrand in the neighbourhood of the 
point x = 0 does not prevent the convergence of the integral. 
Similarly the behaviour of the integrand in the neighbourhood of 
the point x = 1 does not prevent convergence of the integral for g > 0, 
for this integral will only be divergent for g <0. We can therefore 
conclude that in order that the integral B( p, q) should be convergent it is 
necessary and sufficient that p > 0, q > O and we shall assume this to be 
so in future. As we know from § 107, the infinite interval of integ- 
ration in the integral [(s) does not prevent convergence of the 
intcgral for any s. But ifs < 1, the integrand is not bounded in the 
neighbourhood of the point « = 0; since for x + 0 


yao} et ~ ee 


*) BC p,q) and Is) are read as follows : “beta of p and g” and “gamma of s’”, 
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therefore we can conclude that in order that the integral I'(s) should be 
convergent it 2s necessary and sufficient that s > 0. 


2. Let us now show that the function B(, g) is continuous at 
every point of the region of convergence of the integral, 7 ¢. for every 
value of p > 0, ¢ > 0. This follows from the fact that for all arbi- 
trary positive numbers 9, G9 the integral B(/, q) will converge 
uniformly in the region p > po, g > Gq. In fact, if p > py, g > Gs 
we have in the interval (0, 1) irrespective of x 


xP CL — x) <x Pon} (1 — x) %y7}, 
and therefore for every « > 0 


€ € 


[ etd—a et dec xt! (Iasi ds (p> fo aa), 


and we also have a similar inequality for the interval of integration 
(1 — ¢, 1) which proves uniform convergence of the integral B(, q) 
in the region p > fo, q > Yo (cf. $ 110 test for uniform convergence 
and final note). 


Uniform convergence of the integral I'(s) is proved in exactly 
the same way in the region 59 < 5 < So, where Sg and So(s4 < S4) 
are arbitrary positive numbers (for this integral the region of uniform 
convergence must be bounded from above unlike that for the integral 
B(, q), since it can readily be shown that if we have an infinite 
limit, convergence is non-uniform in the whole region s > 5,4). The 
function TI (s) is therefore continuous for every s > 0. 


3. When s > 0, integration by parts gives us: 


L(stl)= [= e*dx=—xie* ot s | xe dear T is), 
0 


since «°e7* vanishes at x = 0 and tends to zero as x > oc. Hence 
Tis + 1) =sT(s) (s > 0). (1) 


Using the same relation again we obtain for every natural number n 
and for every s > n — 1 


P64 1) 2s6= neo DECS2 ey: 83 
In particular, when s = n 


Tin + 1) =n(n—1)...2.1. 0 (1) 
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But 
T(l) = | ede SA, 
0 


and we obtain for integral values of n > 1 


Tin+1) =n! 


The importance of this remarkable formula is mainly due to 
the fact that it gives a simple analytical formula fer the expression a!: 


ne dx Gry 2. see) (3) 


ni= 


om} 


which also hold when n = 0 if we assume as is usually done that 
0! = 1. But, in contrast to the expression for #!, the integral on the 
right-hand side of the equation (3) holds not only for integral values 
of n but for every n > —1; it is therefore useful to apply formula (3) 
for evaluating the expression for x! when the values of x > — | are 
fractional; as a result we obtain an analytical expression for n! in the 
form of a continuous function of 2m which retains its usual value for 
integral values of n > 0. 


If s > 0 is not an integer, then an integer n > 0 can be found 
such thatn <s <2 -+ 1; according to formula (2) we have 


E(s) = (s — I)(s — 2)... (s — n)I(s — n)3° 


since 0 < s —2 <1, therefore, this formula replaces the study of 
the function [(s) in the interval (1, + 1) by the study of its be- 
haviour in the interval (0, 1); and since n > 0 is an arbitrary integer, 
therefore, by knowing the course of the function T'(s) in the 
interval 0 <s <1 wecan evaluate it by means of simple elementary 
methods and determine its properties in the whole region s > 0. 
All this follows directly from the fundamental “functional! equation” 
(1) which the function I(s) satisfies. 


4. Formulae for lowering tle argument, analogous to formula 
(1), can be deduced for the function B(f, g). Let p> 0,¢ > 0. 
Integration by parts give: 
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1 
a a Sane 


1 
aePet it 
-| 25 i (1 — x)? ot ean ba (1 — x}s-t we; 
0 


and since we have identically 


xerl — xP — xP (L — x), 


therefore 
Bip + 1g + 1)= pe Beth a—Be+h a+b} 
and consequently 
1) ] ; 
Bp ste loge = yt Bp pola.gs 


an analogous formula which lowers the first argument evidently also 


holds: 


p 


ae a eae ea ee 


By applying this last formula to the right-hand side of the 
previous formula we obtain the symmetrical formula: 
bq 


re -A ton 0 5: 1 3F 
Bip+l,¢t+)) GA eye Bp,q)  (p>0,¢>0). (3’) 


5. Weshall now establish the remarkable connection between 
the functions B(p, g) and ['(s). Replacing the variable of integra- 
tion in the integral B (, ¢) 


\ ] ans ae 


ee ae 
we obtain 
. dz l-—+* 
| en et = — 3 = --, 
1 a l+2’ dx (4 zy?? is 
and we readily find: 
q-1 
Bip a= |) ag de (4) 
0 
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On the other hand, the transformation of the variable x = z /%, 


where « > 0 is constant, gives us for s > 0. 


foe] 








[en eet dy = Pa s—l p- 2 dz _ r is), 
as as 
0 0 
therefore for z > 0, p > 0, g > 0 
i eae i + 4) 
| urte 1 é u(l1+z) du ea ee ere 7 
0 


Formulae (4) and (6) give: 


wo gich 
Pip+q)Blp, 9) =| T(p+q) fae dz = 
0 


I 
Sey 3 
Neen 
oe 
4 
one, 8 


a 


= | | ze} yPtI-l e~u(l+2) du dz. 
0 Oo 


be) 


yPta-l e-ult+2) dy dz = 


(5) 


(6) 


(7) 


Let us at first assumethat p> land g>1; then it can be readily shown 
that the order of integration on the right-hand side of this formula 
can be changed; we shall show in this connection that all assumptions 
made in theorem 4 § 110 also hold here. In fact, denoting the 
integrand by f(z, u) we can readily see that this function is conti- 
nuous and non-negative in the region of integration. Moreover, the 


function 
[ Sg, u) du =z} i ubtenl eure) dy = T (p+ Oi 
0 
(ef. (6)) is continuous for 0 < z << + and the function 


gh grt de ay 


| F(z, 4) dz = et amet 
0 


= T (gute 


gat 


i zeta 


{Pi 9-1 L L@ _ 


yt 


(8) 
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(we have used formula (5) for integration} is continuous for 
0<u<+o,. In accordance with theorem 4 § 110 it therefore 
follows that existence of the integral on the right-hand side of (7) 
implies convergence of the integral 


[fv wt) az { du 
0 0 


and that these two integrals are equa] to one another so that, accord- 
ing to formula (8) 


rie-+a) Bip, a) = [{ 
0 


=| YT (g) ute" du = I (p) I (q). 
0 


Therefore for all values of p > 1, ¢ > 1 we have: 


LD (py Tq) | 
IP eg) 


Let us now assume that # and q are two,arbitrary positive 
numbers. It therefore follows from the above proof that we have 
(sncep+1>1,¢7+1> 1); 


B(p, 9) = (9) 


Eip+ (q+ 1) 
(p +q +2) 





Bip +1¢a)< 


Expressing all values of the functions B and Lf by means of the 
formulae (1) and (3’) we obtain formula (9) after making obvious 
reductions; hence formula (9) is proved for all values of p > 0, ¢> 0. 


This most important relation thus enables us to replace the 
study of the function B(p, q) by the study of the function I (s) and 
in some cases, conversely, to elucidate the properties of the function 
['(s) from the corresponding properties of the function B (f, 4). 


In particular, when # and g are natural numbers, it follows 
from formula (9) that 


(p — 1)! (q — 1)! 





548 A'COURSE OF MATHEMATICAL ANALYSIS 


Example J. In many applications it is useful to evaluate the 


a 
5)=s a e7* ax. 
0 


The replacement of the variable of integration « = u? gives: 


formula 


T (5) =2{ om tt Safin (10} 
0 


(cf. example 3 § 111). 


Example 2. The theory of Euler’s integrals enables us to 
evaluate integrals of the following type which occur frequently in 
applications : 


P| 


2 
An = | sin” x cos™ x dx, 
0 


where 7 and m are non-negative integers. ‘The replacement of the 
variable sin? x = u gives: 





I 
1 = Lie 1 n+1 m+1 
oe 2 ih a Bp ee 
Anm = 7 | « (1 — u) du 7B ( yo) = 





= 2 . as a 


In this expression all arguments of the function I are either integers 
or halves of integers. Hence by using formula (tO)all the three values 
of this function can be evaluated in every case. 


§ 113. Stirling’s formula 


In § 112 we have obtained the formula 


ni | xt e-* dy (1) 
0 
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which, when n > Ois an integer, gives a simple analytical expression 
for n! and defines the function n! for other values ofn > — 1. The 
factorials of large numbers frequently play an important part both in 
theoretical considerations and in practical calculations; and since, by 
definition, the factorial of a large number has a complicated structure 
which is inconvenient for evaluations whose accuracy cannot be deter- 
mined directly, therefore for Jarge values of n it is convenient to have 
a simple readily accessible analytical expression for n!. Formula (1) 
does not by itself provide this expression, since it is not sufficiently 
clear for direct evaluations. However, by taking formula (1) asa 
basis we can deduce an approximate formula for 2! which satisfies all 
these requirements. This paragraph is devoted to this deduction 
which is very instructive; the method for the evaluation of the 
integral (1) which lies at its basis is frequently also used in other 
analytical problems. 


For greater clarity we shall divide the deduction into several 
stages. 


1. We shall at first convert the integral (1) into a more con- 
venient form by replacing the variable of integration 


x=n(1l+ 2), dx = ndz, c=, 





which gives : 


a 
ni = rth en { (1 + z)e pedes 
—] 


we shall assume in all what follows that : 


(1 + z) e* = 9 (2), 


so that 


nia anten | {9 (z) }* de (2) 
~] 


2. In order to study the behaviour of the integrand we must 
now study the elementary function 7 (z) in detail. Since 


eo’ (Z) = — Ze, 
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therefore the function 9(z) increases for z < 0 and decreases for 
< > 0; it has its maximum equal to unity at the point z= 0; 
e {(— 1) = 0 and when z > 0, the function 9 (z) is positive and 
monotonically tends to zero as z > oo ; the graph of this function is 


schematically represented in fig. 69. 





We have further 
: In ¢ (z) = In(Q] + z) — <. 


According to Taylor’s formula 


where « depends on z and _ it tends to a definite limit for z > 0 and 
is therefore bounded. Hence 


In 9(z) = — He + ae", 
and consequently 
nz" 
nin 9 (z) = aa ee anz, 
and therefore 
— nz? 
a ae 3 
a ae a (3) 


Let us note that the infinitely small quantity ef — lis equivalent to 
t for t— 0i.e. the ratio (e* — 1)/¢ tends to unity as tf > 0 so that 


ef=1-+ Bt, 


where 6 remains bounded for t-> 0. Therefore if m and z change 
such that nz? > 0, then 


pune? — 1 + Banz3 = | + Y nz, 
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where Y is bounded for nz* > 0; hence the equation (3) gives us for 
3 Pi i 
nz? > 0: 


2 
nz 


le@ yr Se * (tyne), 
where Y is bounded. This equation gives us the required evaluation 
for the integrand in the integral (2). 


3. Let us now make a plan for further evaluation of the integral 
In) = | (9 (a }*de, (4) 
—1 


Since the function 9 (z) is equal to unity at z = 0 and it is confined 
between 0 and | at all other points of the interval of integration (cf. 
Fig. 69), therefore, for large values of n the integrand is negligibly 
small everywhere except in a short interval which surrounds the point 
z = 0; the region in which the integrand has somewhat greater 
values will be the smaller, the larger n is. This naturally leads us to 
believe that we should exclude from the interval of integration a 
short interval (— A, A) surrounding the point z = 0; this must be 
done enough accurately taking into consideration the smallness of the 
values of z involved in the integration; we must evaluate the integral 
along that interval and subsequently show, by using rougher approxi- 
mations, that the integrals along other interval of the general interval 
of integration are negligibly small in comparison to the calculated 
value along the interval (— A,A). It is obvious that the number A 
must, in this case, depend on n and tend to zero for n > oo. 


This is the method which we shall use. Let @ denote an arbi- 
‘rary Coustant confined between 1/3 and 1/2 (for example 9 = 2/5 or 
6 = 5/12). We find the calculation that a convenient value for A is 


A= Pal 
We shall use this value in further arguments. We thus divide the 
interval of integration (— 1, + o) into three parts: (— 1, —A), 
{—A. A) and (A, + @) ; the integral (4) is correspondingly broken up 
into three terms each of which will be evaluated separately. 


4. Let us begin with the most important integral 


a 
£ 


q; i= | le @}rdz. 
—A 
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We have along the whole interval of integration : 


|nz? | <nA3 = nb 20 + 0 (n > 00), 


since § > 1/3, and hence 1 — 59 < 0. We can therefore conclude 
from 2 that in the whole interval (~ A, A) 


2 


fei) yeae = {14 yne%}, 


where Y remains uniformly bounded in the interval {— 4,4) for 
n> oo: 


[yl<e¢ (n->0,|z| <A), 


where ¢ isa positive constant. ‘“herefore 








A nae a 2 + © age 
Fs (n)—| oF de | <onrt | e %dz< ani-00/ e 2 dz, 
aay —id — © 
But 
ao ne oe co foe) ; = 
| gtd a/ 2 | ew dux2 a/ 2 gue fia 
n n Vion 


(cf. § 111, example 3); therefore when 1 > 00, 





: me 155 l 
iT, (n) ~| ge de | < en eee = ) ee) 


The integral 





ee poe 
| é 2 pe Mer 
Vin 
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only by the double value of the integral 


for the lower limit of the last integral is equal to n}~9/ V2, since 
A = n-0 and, since @ < 1/2, it increases indefinitely together with 
n; therefore the last integral is indefinitely small for n—> «0; the 
whole right-hand side of the last equation is a quantity of the form 
o(1/+/n). Hence the relation (5) gives : 


i,(n)— ped <2 — dz +.0(F—)=0( —); 


won 





or 








V2n l 
Lor Tire + 0 >=). (6) 


We have thus reached our goal as far as the integral /, (n) is 
concerned : we represent it as a sum of a very simple ‘‘principal 
term” \/ 2x/4/n and another term about which we only know that 
it is infinitely small in comparison to the principal term for 2 — ©. 


5. Let us now evaluate the integral 
=k 
Ian) = | C9 pr ae 
—1 


-ince the function 9 (z) increases in the interval of integration, 


Derefore : 


Ia) < £9 (— A} (1-2) <9 (- NF (7) 


e(— A) = (1—A) e, 


r2 a3 a2 
» $1 \—A)=A4+In (1—A)=A— | A+ +h +... | <a 





a2 1~—29 

n n 

ning(~a)<—sra—tL, 
1 1+2 ic 
= —> Nn 

fo(—A)}><e *" =e : 
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where 7 = 1 — 26 > 0. But we know (cf. example 7 at the end of 
§ 37) that for arbitrarily small + > 0 the right-hand side of the last 
equation is infinitely smallin comparison to any power of n for n-> X, 


: : : 1 —} 
for example in comparison with ae =n  ® , Therefore equation 


(7) gives : 


I, (n) =0 ee: (8) 


6. Let us finally consider the integral 
Ia (ny =| £9 (2) "de 
oN 


Here it is again convenient to divide the interval of integration into 
two parts : 


4 oo 
Is (n) = 1's (om) +hm—= [ (el) }rde+ | Cela trae. 
i 4 


—he function 9 (z) decreases in the interval (A, 4) and therefore does 
not exceed anywhere the value ¢ (A) so that we have : 


4 
I's (n) = [ te} dz<(e@}4—N <4} - 
x e 


But by means of Taylor’s forinula we readily obtain for x F 
? 
In 9 (A) i ca ate (A’), 


and therefore for a sufficiently large value of n 


2 


A 
Ing (A) — eae 


hence 
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where = 1 — 28 > 0. As in 5 we can therefore conclude from 
(9) that for n— oo 


Toye o(=). (10) 


In order to evaluate the integral /’’;‘(n) we note that for x > 4as 
can be readily calculated *), 1+x < ¢+*/*,and therefore 9 (x) < e—*/*, 
Hence 


wo 3 @w fe =) 
I (n)= [Cele nds<|¢ 2 dx =| e 2 as ra) (1 1) 
ne 
4 4 0 
forn—» co. It follows from (10) and (11) that 
, ” ] . 
y(n) = 1's (n) 41's (nr) = 0 ( (= ). as 


7. The relations (6), (8) and (12) give: 


ae 


r=] GOP de=h +h (tile) = Y 284 0( 1 j= 
—1 Vn Vins 
= ¥2 11 +0 (1) 
Vin 


We therefore have as a result of (2) : 
ee 
a/ 


n 


ni == ntl et 


[l to(])] = ne" V2nn [l + 0(])]}. 


We have thus achieved our purpose. The composite function 
n! can be approximately represented by the simple and convenient 
analytical formula 


Cint lb =ntan%e™ Y2xn[1 + 0 (l)]. 


The latter is one of the most important formulae of mathematical 
analysis and is usually known as Stirling’s formula ; it has numerous 
applications. With regard to the last term of this formula we have 
only established that it is infinitely small in comparison with the 

*) It is sufficient to show that the function e #/? — 1 — x is positive at x = 4 
and increases for x = 4. 
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principal term of this formula for n—> oo; in other words, we only 
aim at isolating the principal term of Stirling’s formula and we are 
not concerned with the evaluation of the last term. In practice the 
latter evaluations are often also needed ; they can be obtained with- 
out undue difficulties by using the method used for obtaining the 
‘expression for the principal term ; however, for this purpose all cal- 
culations would have to be performed with much greater accuracy 
and we cannot go into detail within the scope of this book. 


Stirling’s formula is frequently written in the equivalent logari- 
thmic form 


In P(n+1)=in(n!) nn n-ne > Inn + = In 2=+0 (1). 


CHAPTER XNXVI1 
DOUBLE AND TRIPLE INTEGRALS 


§ 114. Measurable plane figures 


1. Introduction. In the same way as the methods and concepts. 
of differential calculus, imitially considered for functions of one inde- 
pendent variable, were subsequently developed for functions of any 
number of variables (chapter 22:, so the fundamental concepts of 
integral calculus can also be successfully extended to functions of 
several variables. ‘This holds for the basic concept of an integral as 
limit of a sum of a definite form; we have seen that the origin of 
this concept was mainly due to practical requirements. In this 
chapter we shall briefly consider fundamental problems connected 
with integration of functions of two or three variables. All that we 
shall say in this connection can be easily extended to functions of 
any number of variables. 


The region of integration of a function of one variable usually 
consists of an interval or, in more complicated cases, a group of 
intervals The region of integration of a function of two variables. 
is a plane figure. If we only consider the simplest figures, 7.e. figures 
bounded by simple closed curves, we must still deal with a large 
variety of forms of such ‘‘regions of integration”. This variety which, 
has no parallel with functions of one variable requires a detailed 
study of some properties of plane figures before we can proceed with 
the study of double integrals. This paragraph is devoted to this. 
subject. 


2. Plane figures. In its most general from we shall call a plane 
figure an arbitrary set F of points ina plane. An arbitrary point A! 
in the plane is said to be an interior point of the figure J° if it is the 
centre of a circle with its all points belonging to the figure F (fig. 70). 
The point B with centre of a circle not having any point which, 
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belongs to the figure F is said to be an exterior point of that figure. 
Finally a point in the plane which is neither an interior nor an 
exterior poiht of the figure / is called a boundary point. Thus the 
point Cis evidently characterised by the fact that any circle with 
centre at C' contains points which belong to the figure F as well as 
other points which do not belong to that figure. 


It follows from the definition that an interior point of the 
figure F always belongs to that figure whereas an exterior point can 
never belong to it. A boundary point may or 
may not belong to the figure F. Thus if F is 
the set of interior points of a circle, then no 
point on the boundary of the figure F belongs 
to this circle; if however F represents the set of 
interior points of a circle as well as points on its 
circumference, then such a figure will contain 
all its boundary points. 





Fig. 70 


The set of all boundary points er a given 
figure (i.e. points which belong and which do not belong to this 
figure) is called the contour (or boundary) of this figure. 


A figure which does not contain a single boundary point (i.e, all 
points are interior points) is’said to be an open region; a figure which 
contains all its boundary points is said to be a closed region. If M, N, 
P respectively denote the sets of all interior, exterior and boundary 
points of a figure F, then, as the reader can readily see, M and WV are 
always open regions whereas P, Af+P and V+P are always closed 
regions. 


Lemma 1. The rectilinear section AB which connects the interior point 
A with the exterior point B of the figure F contains at least one boundary point 


of that figure. 


Proof. Let us agree to call every rectilinear section zormal if 
one of its ends is an interior and the other an exterior point of the 
figure F. According to the conditions of this lemma the section AB 
is normal; if its middle does not lie on the boundary of the figure F, 
then, evidently, one of the two halves of this section will be normal. 
To this half we can again apply the above argument, and so on. 
‘Sooner or later we shall obtain a section whose centre lies on the 
boundary of the figure F (and this will prove our lemma) or we may 
obtain a contracting sequence of normal sections. In that event the 
common point D of all these sections (lemma |! $18) evidently 


DOUBLE AND TRIPLE INTEGRALS Da2 


possesses the property that any circle with centre at D contains an 
infinite number of normal sections, 7.¢. it contains points which belong 
to the figure F as well as points which do not belong to it. But this 
implies that D lies on the boundary of the figure F. Our lemma is 
thus proved. 


3. Measure of plane figures. In chapter 12 we have determined 
the area of curvilinear trapeziums and figures consisting of curvilinear 
trapeziums. We must now consider the evaluation of areas gn a 


wider basis. In order to distinguish 
our new definition of areas from the Ee 


former definition we shall now speak i / | 
A) WY’ 






not of areas but of measure of plane 
figures. In doing this we must try to ay, 


generalise our new definition and see 
that this measure should, in fact, 


always exist and coincide with the 
area defined earlier for figures whose 
areas can be calculated in accordance 
with our former definition. 





aS 





Fig. 71 


Let us assume that we are given an arbitrary bounded plane 
figure F. Let us draw in the given plane two families of mutually 
parallel lines as shown in fig. 7]. The lines of each family are such 
that the distance between any two adjacent lines is always constant. 
The drawn net of straight jines evidently divides our plane into 
equal parallelograms which we shall call the cells of our net; we shall 
always regard all points on the contour of such a parallelogram 
as belonging to the corresponding cell, so that each cell is a closed 
region. The longest diagonal of the parallelogram is evidently the 
diameter of this cell. This quantity, which is the same for all cells, is 
called parameter of the given net S' and denoted by ¢(S) or simply 
by p. 

The cells of the net S can, in general, be divided into two cate- 
gories with reference to the figure F: inner cells, all points of which are 
interior points of the figure / and outer cells, all points of which are 
exterior points of the figure /’; finally all remaining cells are called 
boundary cells (with reference to the-figure F; in fig. 71 one cell of each 


type is shaded). 


Lemma 2. Each boundary cell contains at least one point on the boun- 
dary of the figure F. 
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Proof. In fact, otherwise each point of the given cell would 
either be an interior or an exterior point (with reference to F) and 
not all points can then be interior or exterior points, for if it were so, 
then-the cell would either be an inner or an outer cell. ‘Therefore 
the given cell must contain the interior point A and the exterior point 
B of the figure F. In accordance with lemma | the section AB which 
completely belongs to the given section contains a point on the boun- 
dary which proves lemma 2. 


Let J, (#) denote the sum of areas of all inner cells of the net S 
(with reference to the figure F). Evidently the sum of these areas 
is different for different nets S; however, the set of the values of the 
quantity J; (fF) has evidently an upper limit for all possible types of 
nets, since the figure J” which by definition is bounded lies entirely 
within a circle Cand the quantity J, (F) can never exceed the ‘area 
of this circle irrespective of S. Therefore there exists an upper bound 
I (F) for all the quantities J; (F). 


Theorem 1, J; (F) > J (F) for p (S) > 0. 


As usual, the statement of theorem | implies as follows: There 
exists a 8 >> O for an arbitrary < > O such that J, (F) > I (F) —< 
for every net S with a parameter 9 < 6. 


Proof. Since J (#) is the upper bound of the numbers J, (F), 
therefore for every © > Oa net S, can be found such that 


ig (OE) SF) Se. 


We shall regard this net as fixed in all subsequent arguments of this 
proof. Let us consider an arbitrary inner cell A of the net Sy. This 
cell is a closed region; on the other hand, the contour D of the figure 
F is, as we know, also a closed region. The regions A and D have 
no points in common, since all points of the cell A are interior points 
of the figure F. It follows from theorem 4 $ 87 that the distance 
between the regions A and D is positive. This argument holds for 
every inner cell A of the net Sy. If ,5 denotes the shortest distance 
obtained in this way, then any point of any inner cell of the net Sy is 
evidently at a distance not less than 6 from the contour of the 
figure P. 


Let S now denote an arbitrary net in which e (S) < 6 and let 
A be an arbitrary point of an inner cell of the net So. A is an interior 
point of the figure F and therefore it must belong to an inner or a 
boundary cell of the net S; however, it cannot belong to a boundary 
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cell, since in that case, in accordance with. lemma 2, it would be at a 
distance less than 8 from the contour of the figure F. Hence every 


point .4 of every inner cell of the net Sj must belong to an inner cell 
of the net S$. Hence 


1, (F) > I, (F) > I(F) — ¢, 
provided @ < S for the net S. This proves theorem 1. 


The set of inner cells of any net of straight lines evidently 
belongs entirely to the figure F. If we add the boundary cells to 
inner cells“of the same net, the sum of whosc areas being denoted by 
hi, (F), we evidently obtain a figure which, conversely, contains all 
points of the figure /. It is thus, evident that if we can ascribe a 
definite area to the figure F, then for every net S' this area must be 
confined between J; (/’) and J; (F) +4 (F). But we have just pro- 
ved that 7, (F) always tends to a definite limit asP + 0. Hence the 
area I, (F) + K, (F) which surrounds the figure / tends to the same 
limit; we are therefore justified in assuming that this limit is equal 
to the area or, as we now prefer to say, to the measure of the figure F'; 
the figure F itself is in this case said to be measurable. Since 
I, (F) > I (F) always (theorem 1), therefore in ordcr that the figure’ 
F should be measurable it is necessary and sufficient that 


K, (F) +0 (p+ 0), 


i.e. the sum of the areas of the boundary cells should tend to zero together with 
the parameter of the net. 


In this case the above defined quantity / (F) is the mcasure of 
the figure FP. 


4. Properties of measurable figures. Thesum F, + F, of two 
measurable figures Ff, and F, is the set of points which belong to at 
least one of these figures; the sum of any number of figures is deter- 
mined similarly. The iniersection or common part I*; F, of the figures 
F, and F, is the set of points which belong both to F, and Fy; this 
definition also applies to the intersection of any number of figures. 


Theorem 2. If the figures F, and F, are measurable, then the figure 
F, + Fy is also measurable; if at'the same time the figures F, and Fy, have 
no common interior points, then 


T(F, + Fy) = 1 (Fi) + 7 (Fp). 


Proof. 1) Every interior point of one of the figures F, and F, 
is also an interior point of the figure F; + F: Therefore point A 


562 A COURSE OF MATHEMATICAL ANALYSIS 


on the boundary of the figure F, + /, cannot be an interior point 
of either F,; or Ff. However, it cannot be an exterior point of either 
figures, for then it would evidently be an exterior point of the figure 
F, + £. Hence the point A must be a boundary point of at least 
one of the figures /; and /. But in this case every cell of any net S 
which is a boundary cell of the figure Ff, + F, must also be a cell on 
the boundary of either F, or F,; we therefore have for every net S': 


Ky (Fy + Fa) < Wa 4) + A, (FS). 


But since the figures /', and F, are measurable, therefore A’; (F,) and 
Fs (fF) tend to zero as ep > 0; hence the last inequality shows that 
we also have 


Kyi, + Iz) > 0 (p > 0), 
and this, in its turn, implies that the figure , + F2 is measurable. 
2) Let us now assume that the figures Fy and Ff, have no 
interior points in common. Let us consider an arbitrary inner cell 
A of an arbitrary net S with reference to the figure Ff, + Fy. It is 
evident that the cell A cannot be an outer cell of both the figures F; 
and fy, for in that case it would also be an outer cell of the figure 


Ff, + Fy. Therefore the cell A must either be an inner cell ora 
boundary cell of atleast one of the figures /*, and /, and, consequently 


1(Py + Pe) S15) + ASA) + Is Fe) +s (PF). (1) 


Since /, and /, have no interior points in common, the set of cells 
which are inner cells of either F; or F, have an area equal to 
1,(F,) + I (Fz); and since each of these cells is also an inner cell of 
the figure /, + /4, therefore 


Ts) + Ts (Fa) <7 (Fi + Fo). (2) 
It follows from (1) and (2) 
Ts(F\) + Is(Fa) SIs (Fy + Fe) <15(FA) + Wa(F) + 
+ 1,(F) + Ks (F,). 
By making the net S successively small we note that 
I s(Fy) > 1 (Py), Is(Fz) > 1 (Fx), 1s + Fe) > 1, + Fy), 
. K, (Fj) +0, Ks(F)) > 0, 
and we obtain in the limit: 
IO, + Fe) = 1) + IF), 
which was to be proved. 
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It is evident that theorem 2 can be extended to include any 
number of terms by simple induction. 
| 


Theorem 3. The intersection FFs of tivo measurable figures is also 
measurable. 


Proof. Let 4 be an arbitrary point on the boundary of the 
figure FF; it can be readily seen that in this case the point A must 
be a boundary point of at least one of the figures F, and Fy; in fact, 
the point A cannot be an exterior point of either F, or Fy, for it 
would be an exterior point of the figure F\F, as well; on the other 
hand, it cannot be an interior point of either figure, for in that case 
it would also be an interior point of the figure F\F,. Therefore the 
point 4 on the boundary of the figure F{/, must be a boundary point 
of either F, or Fy; hence for any net S a boundary cell with respect 
to F\, must be a boundary cell either with respect to F, or with 
respect to F,; this gives: 


Ks (FiFz) < Ws) + Ks (FQ). 


Since F and fF, are measurable, the right-hand side tends to zero as 
2 — 0; the same also holds for the left-hand side and this implies 
that the figure #\F, is measurable. 


Theorem 3 evidently holds for the intersection of any number 
of measurable figures. 


Theorem 4. Let A (8) denote a set of points in a plane, which are at a 
distance less than 8 from the contour of the plane figure I’. Therefore in 
order that the figure F should be measurable it is necessary and sufficient that 
the set A() should be contained in a fimte group of parallelograms, the sum 
of whose areas is less than © for arbitrarily small ¢ > 0 and sufficiently 
small 8. 


Proof. 1) Necessity. Let the figure F be measurable and let § 
be a net of straight lines for which ¢ is so small that 


KA(F) <¢; 


let & be the lower bound of the distances of all inner and outer cells 
of the net S from the contour of the figure F (5 > 0 asa result of 
theorem 4 § 87). The points of the set A (5) cannot therefore belong 
to inner or outer cells of the net S so that the set A(&5) must be 
contained entirely by boundary cells of this net, the sum A; (/) of 
whose areas is less than ¢. 
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2) Sufficiency. If we have oe < & for the net $, then all 
boundary cells of this net belong entirely to the set A (5); therefore if 
the condition of theorem 4 is satisfied, then for arbitrarily small ¢ > 0 
we have for a sufficiently small 


KF) <«, 


which implies that the figure F is measurable. 


Theorem 4 has many important corollaries. Let us assume that 
the measurable figure F is divided into parts of arbitrary shape 
which we shall, as before, call cells, and for which we shall only 
require that they should be measurable figures with no interior 
points in common in pairs. Let e(7) denote the greatest diameter 
of the cell of the division 7 of the figure F. The definition of inner 
and boundary cells remains as before (7.e., we say that a cell is an 
inner cell if all its points are interior points of the figure F, otherwise 
it is a boundary cell). Let us denote by Jr (F) the sum of measures 
of the inner cells of the division 7 (with reference to the figure F) 
and by I(F), as before, the measure of the figure F. 


Theorem 5. Jf the figure F is measurable and can be divided into 
measurable cells, then for 9 > O 


It(f) > I(F). 


In fact, this implies as follows: a 5>0 can be found for every 
¢ > Osuch that, we have for o(T) < 8: 


| Ix (F) — I(F)| <e. 


Proof. If 9(7) < 5, every point of any boundary cell of the 
division T will belong to the set A(5) of theorem 4 and therefore, 
provided 6 is sufficiently small, the set of all boundary cells will be 
contained by a finite group of parallelograms, the sum of whose areas 
is less thane. Hence the sum of the areas of the boundary cells is 
less thane *). But the sum of measures of all cells (inner and 
boundary cells) is equal to /(/’) (theorem 2); therefore the sum Ir (F) 
of measures of inner cells differs from J(/) by less than ¢, which 
proves theorem 5. 





*) Strictly speaking, in order to prove this statement we must also show that: 
1) if the measurable figure Fy contains a part of the measurable figure Fy, then 
I (Fy) <i (F_) and 2) the measure of a parallelogram is equal to its area. This 
first statement follows directly from the definition of measure and the reader will 
have no difficulty in proving it. The second statement, which is almost self-evident, 
Will be proved somewhat later {theorem 6). 
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5. Examples of measurable figures. We shall now show that 
there exist wide classes of more or less simple measurable figures and 
that for figures, whose areas are calculated by means of other special 
methods, their area coincides with the measure. 


Lemma 3. Let the function y = f(x) be continuous in the interval 
(a, b) and let for every 8 > 0 A(8) be a set of points in the plane, which are 
at a distance less than § from the curve y = f(x) (a<a* <b). In that 
case for arbitrarily small ¢ > 0 and sufficiently small 8 the set A(8) can be 
covered by a finite group of rectangles the sum of whose areas is less thane. 


Proof. Let us divide the interval (a, 5) into n equal parts 
(b — a) / n=S in length and let 2 be so large that the vibration of the 
function f(x) in any subinterval < § in length should not exceed ¢. 
Let the points of division be a@ = xy < *%, <...<( x, = 6 so that 
Xt — Xe-y = 8 (1 Ck <n). Let us denote by M, and my, the 
greatest and smallest value of the function f(x) in the subinterval 
(x;-1, *y) of length equal to 8, so that M; — m, < ¢ (fig. 72). 


Let MN denote the interval «,-. <« <x, ofthecurve y = /(x). 
It is evident that every point in the plane which is at a distance less 
than 8 from the arc MN must lie 1) within the strip x, — 6 < x 
<x; + § and 2) within the strip my —8 < y < M,, + 8 and 
hence within the rectangle (x,-. — 8< *« < x, + 8, m, — 8 
<» <.M),, + 5) whose area is 

38 (M;, — m,-+ 28) < 38 (e + 28); 

the sum of the areas of these rectangles constructed forall k (1<k<n) 
does not exceed 35 (¢ + 25) 2 = 3 (b — a) (¢ + 28) and is therefore 
as small as we please, provided ¢ is sufficiently small and nsufficiently 
large And since the set of these rectangles covers the set A(5), there- 
fore lemma 3 is proved. 


Let us now assume that the contour of the figure I is closed 
and can be divided into a finite number of intervals, in each of which 
the curve can be represented by either the equation »y = f (x) or the 
equation x = 9(y). Applying lemma 3 to each interval we see that 
the set A (8) constructed for the whole contour of the figure J’ can 
be covered by a finite group of rectangles, the sum of whose areas 
can be as small as we please provided 8 is sufficiently small. 
Theorem 4 thus gives us the following theorem : 


Theorem 6. Jf the contour of the figure I’ can be divided into a finite 
number of sections each of which can be expressed by either of the two equa- 
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tions : y=f (x), x=@ (9) (where f and 9 are continuous functions), then the 
figure F is measurable. 


By the way all trape- 
ziuins whose areas have been 
evaluated in chapter 12 will 
be measurable; for a trape- 
zium its measure coincides 
with its area as determined 
by the methods described in 
chapter 12. Measurability of 
every rectangle follows direct- 
ly from theorem 6. Hence 
every rectangle is measurable 
and in order to find its mea- 
sure we can select nets of straight lines in arbitrary directions; if we 
take these ‘directions parallel to the sides of the given rectangle, we 
can see directly that the measure of the rectangle coincides with its area 
as determined by elementary methods. It therefore follows from 
theorem 2 that the same thing also holds for every figure composed 
ofa finite number of rectangles. In chapter 12 we have used these 
figures to illustrate the “upper sums” S(7) and the “lower sums” 
s(T) of the given division T. Hence measure of a curvilinear trape- 
zium (composed of the first of these figures and containing the second) 
is confined between s (7) and S (T) for every division T. And since 
the same-also holds for the area of this curvilinear trapezium, the 
absolute value of the difference between measure and area does not 
exceed S (J) — s (T); hence if the function f () is continuous, it is 
equal to zero, since the difference S (TJ) — 5s (JT) can be made as 
small as we please by suitably choosing the division T. 





Let us finally consider a curve expressed by the parametric 
equations 


x= 9 (1), y= 9 (), (3) 


where the functions 9 and » are continuous and have continuous 
derivatives in an interval (fo, ¢,) of variation of the parameter ¢ and 
assume that we have simultaneously 9’ (t) = v’ (¢) = 0 at no point 
in this interval. Let ¢beanarbitrary point in the interval (2), ¢;) 
and let 9’ (¢) 0; because of continuity the function o’(é) retains 
its sign in a neighbourhood of the point ¢ and therefore the function 
x = © (f) is continuous and monotone inan interval which surrounds 
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the point tf; but we know (§ 23) that in this case f is a single-valued 
function of x in that interval and therefore y = t) (t) is also a single- 
valued function of x in that interval of the curve. Hence every point 
in the interval ¢g <¢ < f, can be surrounded by an intervalin which 
the curve (3) can be expressed by either of the two equations: 
pb =f (x), x = fe. (9) (where the functions f; and f, are continuous 
in the respective intervals). 


If we apply the theorem on finite coverage (lemma 2§ 18) to 
the set of these intervals we find that the curve (3) consists of a finite 
number of intervals, in each of which it can be represented by either 
of the two equations: y = f, (x) and x = f, (y) (where f, and fy 
are continuous). Theorem 6 thus leads to the following theorem : 


Theorem 7. Let the contour of the figure F be divisible into a finite 
number of intervals each of which can be expressed by equations of the form 
(3), where the functions 9 (&) and WU (t) have continuous derivatives in the 
corresponding intervals which do not vanish simultaneously. If this is so, then 
the figure F is measurable. 


§ 115. Volumes of cylindrical bodies 


We have mentioned in chapter 12 that the development of 
integral calculus for functions of one variable was prompted by evalu- 
ation of areas of plane figures bounded by contours of arbitrary 
form; at the time we have used this example as an introduction to 
the concept of an integral. The calculation of volumes of bodies 
bounded by surfaces of arbitrary form plays an analogous role for 
functions of two variables. In this case too elementary geometry 
teaches us very little; apart from polyhedra (7.e. bodies bounded ex- 
clusively by planes) it only deals with volumes of bodies whose 
boundaries consist (sometimes in conjunction with parts of planes) of 
parts of spherical (ball-like), conical and cylindrical surfaces. We 
shall begin by giving a definition and developing a method for 
calculation of volumes of bodies bounded by surfaces which are in 
general arbitrary in shape. 


As in evaluation of areas (¢f. chapter 12) where we began by 
considering the general problem in relation to evaluation of areas of 
figures of specific shape (curvilinear trapeziums) we shal] again con- 
centrate our attention on calculation of volumes of bodies of specific 
form which we shali call ‘cylindrical’ bodies. It can be readily 
seen that any body of a more or less simple form can be divided into 
several such cylindrical bodies and, therefore, by knowing to find 
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volumes of these cylindrical bodies, we shall have no difficulties in 
calculating volume of any body whose boundaries are not too 
complicated. 


Let a measurable figure D (fig. 73) be given in a plane which 
we shall take as the coordinate plane XOY. Leta surface be given 
in space to extcnd over the figure D so 
that every straight line parallel to the 
O-axis intersects it at one point only; 
the equation of sucha surface can be 
written in the form 


z= f(% 9), (1) 


where we assume that the function 
S(x,y) is positive and continuous in a 
rectangle which surrounds the figure D. 
Let us now draw a perpendicular from 
Fig. 73. every point of the contour of the figure 
D to the XOY plane and continue it to 
intersect the surface (1). The set of these straight lines reprcsents 
the surface of the cylindrical figure whose generating lines are parallel 
to the OZ-axis. The resulting body which is bounded from below 
by the figure D, from sides by the cylindrical surface which we have 
just described and from above by the surface (1) is a cylindrical body ; 
the definition and development of a method for calculation of volume 
of such a body is the object of this paragraph. It is evident that 
this problem is analogous to calculation of area of a curvilinear 
trapezium. The complication in this case is mainly due to the fact 
that a curvilinear trapezium is always bounded from below by a 
section of a straight line whereas the lower boundary of a cylindrical 
body can consist of the measurable figure D which can be arbitrary 
in form. However, this complication is due to the nature of the 
two-dimensional continuum: on a straight line (2 e. in a one-dimen- 
sional continuum) only a single form of a measurable figure is possible, 
viz. an interval whereas in a plane, even if we restrict ourselves to the 
simplest figures, we immediately meet an infinite variety of shapes. 
For this reason it is desirable to consider right from the beginning an 
arbitrary measurable figure as the “‘region of integration’’. 


\ 





The same difference again appears as scon- as we try to solve 
our problem i.e. when we try to define volume of a cylindrical body 
in analogy to area of a curvilinear trapezium. In the lattcr case 
we begin by dividing the interval (a, 6), which is the lower boundary 
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of our trapezium, into arbitrary parts which we called ‘cells’ of the 
given division. Therefore in this case we naturally begin by arbi- 
trarily dividing the figure D into figures which we shall also call 
cells. But which is the most suitable form for these cells ? We now 
evidently have an indefinitely wider choice than before. Let us how- 
ever, note that in the former case we found it useful not to restrict 
our choice of cells so that our arguments could apply to all possible 
divisions of the given interval. For the same reason we shall in this 
case also try not to restrict our choice in any way. We shall natu- 
rally demand that each cell should have a definite area, ie. it should 
be a measurable figure; we shalJ]l assume further that no two cells 
‘should have interior points in common; in all other respects the 
dimensions, shapes and mutual positions of cells can be arbitrary. 
Let us denote the cells of the given division T of the figure D 
performed in any given order by Aj, Ag, -.., An; let A, denote 
measure of the cell of the same description. 


Let us now choose an arbitrary point in every cell Ay (E14; qx)- 
The product 


SF (Ens te) Ax (2) 


expresses volume of a right cylinder with the base A; and height 
S(éns Ge). If the cell A; is small, then it follows from continuity of. 
the function f(x, y) that the values of this function at different points 
in the cell Az will differ very slightly from one another and therefore 
very little from the quantity f(2,, 7,). If we now cut, subjectively, 
a narrow cylindrical column situated above the cell A, from our 
cylindrical body, then volume of this column will evidently differ very 
little from the volume of a straight cylinder with base A; and height 
Sf (Zn; Gx), 2e. from the quantity (2). And if all the cells are small, 
then volume of the whole cylindrical body which is equal to sum 
of volumes of all such colurmns will only differ very little from the sum 


Y FE ns abe (3) 
=1 


We must emphasize once again that the division 7 of the figure D 
remains arbitrary (provided the cells A, are measurable and suffi- 
ciently small); the choice of the points (1, %,) in individual cells is 
also arbitrary. 

It is evident that in future we must try to make the division T 
progressively “finc’’. But what does it mean ? Let us note that in 
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the former case we have evaluated ‘‘fineness” of the division T by 
smallness of the quantity 1(7) in the greatest of its cells. We must 
naturally act similarly in this case. But how can we evaluate the 
‘dimensions of the cell? It can readily be seen that measure of the 
cell is not suitable for this purpose; in fact, in this case we try to 
make the cells small in order that any two points of a given cell 
should lie close to one another; however, the small dimensions ofa 
cell do not guarantee us this property (the cell may have the shape 
of an elongated rectangle). Let us note that we have agreed to call 
the diameter of a plane figure as the upper bound of the common 
distances of all possible pairs of its points. Therefore smallness of 
diameter of the cell A; is, in fact, necessary and sufficient in order 
that the common distance of two arbitrary points in it should be small. 
If we denote by d(T) the greatest of the diameters of the cells of the 
given division T, then “‘fineness’’ of this division can conveniently be 
measured and evaluated by smallness of the quantity d(T). We shall 
naturally say that the variable division’ 7 becomes “‘infinitely fine” 
if and only if d(T) — 0. 


All that follows is quite clear from its analogy to the definition 
of area of a curvilinear trapezium. If, when the division T 
becomes infinitely fine and choice of the points (z ;, 4) in individual 
cells is arbitrary, the sum (3) tends to a limit V independent of the 
division T and choice of the points (2;, 44) in individual cells of the 
given division, we shall call this limit V volume of the given cylindrical 
body and write: 


V = lim » Din th) Ake (4) 


UT) 


It is clear from above that the exact meaning of this notation 
{in agreement with the accepted general concept of limiting process 
§ 15) involves the following fact: a § > 0 can be found for arbitrarily 
small « > 0 such that for every division 7, where d(T) < §, and 
for every choice of the points (37, 41) the following inequality holds 
for cells of the given division: 


n 
yew NEA — Vice 


k=1 


We have thus established the definition of volume of a_ cylin- 
drical body. The apparatus for calculation of this volume follows 
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directly from the above definition, which is fully constructive ; how- 
ever, in practice, this method because of its complexity gives us even 
less than the method obtained earlier in connection with the defini- 
tion of area of a curvilinear trapezium. Eor this reason we must say 
that we have still not developed a suitable practical method for eva- 
luation of volumes of cylindrical bodies. 

From above we can draw no conclusions as to the conditions 
under which the limit involved in the definition of volume of a cylin- 
drical body exists and is independent of the elements of construction. 
We must therefore still consider all these problems. 


§ 116. Double integral 


As in the one-dimensional case (chapter 14) we can now enu- 
merate many geometrical and physica] problems whose solution in- 
volves evaluation of limits of the form (4) § 115 (masses of thin hete- 
rogeneous plates, centres of gravity and moments of inertia of such 
plates, etc*’. We must therefore study the general properties of these 
limits and find practical methods for their evaluation. 

We shall naturally begin by agreeing on terminology and system 
of notation. Ifthe given function / (x,y) and the given measurable 
figure D have a limit of the form (4) § 115, then this limit is called 
double integra! of the function f (x, y) in the “region of integration’ D and 
denoted by 


[J ren de or [Jeon dvd y.. 
D D 


In the first formula the symbol d gc (‘ element of area’’) should remind 
us of origin of the integral obtained from “integral sums’’ as a result 
of the limiting process 


egae Ak) Ar 

k=] 
We know that the shape of cells in this process is arbitrary ; it is 
mostly convenient to have cells in the forms of rectangles with sides 
parallel to the axes of coordinates ; the integral sums then have the 


form : 
n 


Y f Ents) Ax Ad, 
k=] 


*) We shall consider some of these problems in § 120. 
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and the second formula of the double integral given above, which we 
shall mainly use in future, should remind us of origin of the integral. 
It is obvious that the meaning of both notations is the same. 


If an integral exists, the function f (x, y) is said to be integrable 
in the region D. Nothing is required of the function f (x,y) except 
that it should be defined at every point of the region of integration D 
and bebounded in that region. Thus the function must not even be 
continuous ; it may also assume negative values (in these more gene- 
ral cases the simple geometrical interpretation of double integral 
given in § 115 does not apply). 


As in the one-dimensional case, the concepts of the upper and 
lower sums which are constructed in full analogy to the one-dimen- 
sional case (§ 47) are of great assistance in constructing of the theory 
of double integrals. 

Let M and m denote respectively the upper and lower bounds 
of the function / (x, y) in the region D. Let us assume that we have 
performed an arbitrary division T of this region into (measurable) 
cells Ay, Ag, --, A» and let Mf; and m, denote the upper and lower 
bounds of the function / (x, y) in the cell A ; respectively. We can 
thus construct sums 


n 


1 
Sr=)iM, Ak st = )) my An 
k=1 k=] 


which are uniquely defined by the chosen division T called the upper 
and lowe? sums of this division. These sums possess all properties of the 
upper and lower sums in the one-dimensional case (§ 47, properties 
1° — 4°) ; all previous proofs remain valid except that the cells A, 
are now measurable plane figures. Instead of thelength ) — a ofthe 
interval (a, 5) we must now use everywhere the area D of the region 
of that name. In the proof 3° we must note that the cells Az; are 
measurable figures in accordance with theorem 3 § 114. 


As in the case of a one-dimensional integral we shall agree to 
call the quantity o, = Ad; — m, variation of the function / (x, ») in 
the cell A; of the division TY. It can again be shown that the 
simple relation 


St~sv= Plopar>+0 (d(T) +0] (1) 
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is a necessary and sufficient condition for integrability of the function 
J (x, 7) in the region D. The proof is exactly the same as in the one- 
dimensional case (§ 48). 


The most important consequence of this criterion of integrabi- 
lity is, as in the one-dimensional case, integrability of all continuous 
functions. The function f (x, y) continuous in the bounded closed 
region D is. as we know (§ 88), uniformly continuous in that region. 
Therefore provided d(T) is sufficiently small, the variation ©, of the 
function f(x, ») in any cell Ax of the division 7 will be less than an 
arbitrary preassigned positive number ¢ which can be as small as we 
please ; but this implies that, provided d(T) is sufficiently small, 


since € > 0 is arbitrarily small, the relation (1) holds and the func- 
tion f (x, _y) is integrable in the region D. 


We have seen in the case of simple (single) integrals that a 
finite number of points of discontinuity of a bounded function does 
not effect its integrability (§ 48, theorem4), We can similarly show 
that the’bounded function / (x, y) is integrable in every region D in 
which all its points of discontinuity are situated on a finite number of 
lines of relatively simple type. However, we shall not do so here. 


Double integrals possess several simple properties which are 
completely analogous to those of simple integrals ; the proof of these 
properties is usually quite simple and follows the same lines as the 
corresponding proofs for simple integrals. It is therefore sufficient only 
to enumerate the more important properties and leave the reader to 
provide the proof *). 


1°. If the functions fj (x,y) and fy (x,y) are integrable in the 
region D, then their sum is also integrable in that region and 


[[iA@2t+h eed = 
D 


=[fAwrnag+ [ [Ara 
D D 





*) Let us note that in everything that follows any measurable plane figure can 
serve as the region of integration. 
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2°, fk is an arbitrary constant and the function f (x,y) is 
integrable in the region D, then the function & f(x,y) is also inte- 
grable in that region and 


[ [eres dx dy = anPace dx dy. 
D D 


ac 


3°. Ifthe function f (x, y) is integrable in each of the ‘regions 
D, and D,, then it is also integrable in the region D, + D,; if, at 
the same time, the regions D, and D, have no common interior 
points, then 


{J fi dede = | [reo pie) ie) ee 


D,+De 


4°. If the functions f{ (+, y) and f, (x, y) are integrable in the 
region D and if at every point of that region f; < fo, then 


[ [AGordra < | [Ato avo. 
D D 


5°, If the function f (x,y) is integrable_in the region D, then 


the function | f (x, y) | is also integrable in that region and 
‘ 


| [serra ey <| [if to) | dea. 
B D 


6°. Ifthe function / (*, y) is integrable in the region D and if 
at every point of that region m </f (x,y) < M, then 


m pt<| [yr (x, 9) dx dy <MD*, 
D 


where D* denotes measure of the region D. 


7°, (Mean value theorem). If the function f (x,y) is conti- 
nuous in the closed region D and this region is ‘‘connected”’, z.e. any 
two points of this region can be joined by an open polygon which 
wholly belongs to the region D, then a point (£, 4) can be found in 
this region such that 


j rt. 9) dedy= flex) D*. 


DOUBLE AND TRIPLE INTEGRALS oD. 


In order to prove this we must join two points at which the 
function / (x, 7) assumes its greatest value AZ and its smallest value m 
by an open polygon lying entirely in the region D. We can regard 
j as a continuous function of an arbitrary suitably chosen parameterA 
along that polygon (for example, A can be defined as the length of 
an interval of the open polygon from the origin to the given point). 
We can then apply theorem 3 § 23 to this continuous function. whose 
values at the and points of the given section of variation of the para-. 
meter are respectively equal to M and m; since it follows from 6° 
that 


m< pf [soo dxdy < M, 
D 


therefore on the drawn open polygon (and hence also in the region 
D) a point (2, 4) can be found at which 


FE) = pel [Ser aro, 


D 
which was to be proved. 


We must finally draw attention to an important corollary of 
theorem 5 § 114 which we shall find useful on many future occasions. 
Let the function f (x, y) be integrable in the region D; its integral 
is defined as limit of sums of the form 


DF Ges tr) Ax: 
k 


in all the cells A, of the given division T of the region D, provided 
the greatest diameter of the cells tends to zero. Among the cells Ax. 
we distinguish inner and boundary cells; let ¥; denote summation in 
all inner cells and 2, summation in all boundary cells of the given. 
division so that 


Ves tr) An = yf as Gr) Ak + Df Crs Gr) An 
k : 


and 


y Ar= » Art Ax 


k 
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If » denotes the upper bound of the function | f (x,y) | in the region 
D, then : 


| Vit Ges ti) An < v DE A, = ¥(} Arn a Ax ). 
k 


»But theorem 5 § 114 maintains that if the division becomes indefini- 


tely fine . 
y Ara » Ai: 
k 


{the above sum is obviously the measure of the region D); therefore 
if d (T) > 0, 


YS Ge tn) An 0, 
and consequently 


| | f (x9) dx dy = lim Vf Ens me) Ax = lim Pl fs tx) Are 
D k 


Theorem. Jf the function f (x, y) is int:gratlz in the region D, then 


| [fos2) ded = lim Pf Gare) Ae 
d(T)>0*™1 


D 


where the sum 2, only includes inner cells of the division T. 


Note. The proved theorem remains valid if, apart from all 
inner cells, we include some (any we please) boundary cells in the 
sum 2, (the sum 2, then contains the remaining boundary cells). 


The proof remains unchanged. 


-§ 117. Evaluation of double integrals by means of two 
simple integrations 


We have already mentioned above that our definition of a 
double integral gives a method for its evaluation but this method is 
rather limited because of its bulkiness and unsuitability for practical 
use. We must therefore develop a suitable method for evaluation of 
the given double integral. In most cases evaluation is achieved by 
reducing the double integral into two successive simple (i.e. single) 
integrals. We shall establish this general method in this paragraph. 
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Let the closed region (measurable figure) D where the given 
integral is defined has sucha form that any straight line parallel to 


ri 





yee i 
o| x ; 
Fig. 74, Fig. 75. 


ay 
. 


one of the coordinate axes intersects its contour only at two points 
(fig. 74; this condition excludes all regions similar to that represented 
in fig. 75; however, such a region, provided it is sufficiently simple, 
can always be divided into parts of the required form as shown by 
dotted lines in fig. 75); only lines at the extreme left and the extreme 
right permit this exception ; each of these can share a whole section 
of common points with the boundary of the region D (as, for 
example, the line at the extreme right in fig. 74), 


We shall assume that the function f(x, ») is continuous in the 
region D. In that case the integral 


T= [| f(s 9) dey 


D 


is known to exist and (as a result of the last theerem of the previous 
paragraph, see note) it is equal to the limit of sums of the form for 
d(T) — 0, 


x S (Ek, Ge) Ar 


(where &;, 74 are coordinates of a point arbitrarily chosen in the cell 
A, of the division T and the sum includes all inner cells and any 
number of boundary cells of this division); this limit is independent 
of the division T and choice of the points (2,, 44) in cells of these 
divisions. Therefore in order to obtain the reduction necessary for 
evaluation of the integral J and subsequent evaluation of two simple 
integrals we can choose the division J and the points (&, 7) in the 
cells of these divisions in a way most convinient for our purpose if 


only d(T) —> 0. 
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Let ¢ > 0 be given arbitrarily; in that case provided 5 > 0 is 
sufficiently small, we have 


Jf YFG %) Ae] <e (1) 


for every division T for which d (TJ) < § (and for every choice of the 
points (&, 4.) in the cells of this division). Let us now choose one 
such division in a definite manner. Let us write respectively 
y = (x) and y = 92(x) for the equations of the upper and lower 
parts of the contour of the region D (fig. 74) and assume that these 
two functions are continuous in the interval (a, 5) between the 
terminal abcissae of points of the region D. It then follows from the 
theorem on uniform convergence that an fy > O can be found such 
that when a < *’ < x” S band x’ — «" |< Ay, we have: 


8 
lore) — M11 < Zs lee le) — 2 DI < 2. (2) 


Let us now divide the interval-(a, 6) by means of the following points 
of division : 

A= Xo. X15 s0ey Hy = O 
into a large number of equal parts so that 


Ne— wip =H=hA<chy CL St gn) 


and also h < §/2. Let us draw a straight line parallel to the 
OY-axis through each point of division. The set of these straight 
lines divides the region D into vertical strips (fig. 76). A further 
choice oi cells of division will be made separately in each strip. 


Fig. 77 represents one of these vertical strips confined between 
the straight lines + = x; and x = xi4,. Let Mf, and m, denote 
respectively the greatest and least values of the function 9, (x) in the 
given strip while 47, and m, have similar meanings for the function 
oo (x). Since h < fg, it follows from the inequalities (2) that 


5 $ 
> My, -- Le a (3) 


Af; —m,< 

Let us now draw in our strip (Fig. 77) straight lines parallel to 

the OX axis at the heights m., AZo, m,, My, (let us assume for the 
sake of simplicity that AZ, <_ my ) and divide the interval M,<y<m, 
of the OY-axis into equal parts and draw straight lines parallel to the 
OX-axis through each point of division. These straight lines divide 
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the part of the region D confined in the given strip into parts which 
we shall regard as cells of our divisionT. We have not yet defined 


we 


a i 





S 
os 





Fig. 76 


the number of equal parts into which the interval 14, < »y <m; 
should be divided ; we shall do so now. 


In each cell A, constructed in the given strip as described 
above let us select &; = x; (which will be the same for all cells of 
the given strip) whereas the numbers 4, can be chosen arbitrarily. 
The lowest cell of the given strip is contained in a rectangle whose 
dimensions are h < 8/2 and M,—m,<§/2 and therefore its diameter 
does not exceed VW h* + (Mz — m,)? < &/\/2 < 8. The same evi- 
dently also bolds for the highest cell All remaining cells of the given 
strip are rectangles and the diameter of each is less than 8, provided 
we Civide the interval MZ, < _y < m, into a sufficiently large number 
of (equal) parts. From these rectangles the lowest and highest are 
evidently boundary cells whereas the remaining ones are inner cells 
of our division. 





Part of the integral sum 


eater Ax) Ak; 
k 


which includes the rectangular cells of our chosen strip can be 
written in the form 


m—I 


YF (ea hh’, 


1=0 
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where h’ is the distance between two adjacent points of division of 
the interval (M.,m,) andy, is an arbitrary number confined 
between two such adjacent points of division. 


But the sum 
m—1 


ACLS 
i=0 
for h’ — 0 has the integral 


my 


[F659 0. 
Mo 


as its limit. We therefore have, provided h’ is sufficiently small : 


m—1 my 
| YS inv) bh’ — BL Flea) dy  <he. (4) 
l=0 Mos | 


But since 
My <1 (%i) C Mi, m, Kee (x4) < M,, 


therefore it follows from the inequalities (3) 


and hence 
91 (x4) my 
| [fa & | f652) |= 
Pe (x3) Mz 
| Me ey (%:) 
=| [rouxb + [fon a| <2 = 28, 
pe (x;) my 


where p. is the upper bound of the function | Sf (x, 9) | in the region 
D. It therefore follows from (4) 


m—1 91 (x;) 
| YF (xi, 91) hh! — i] f9) dy | Shee is Soe 
f=0 Pe (xz) 


since there is no reason why we should not choose 8 < ¢/ x. 


ay 
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We have so far considered part of the integral sum which 
embraced the rectangular cells in one vertical strip chosen by us. 
Summing the result over all such vertical strips we obtain : 


n—1 9 1(x;) 
YP sGnmd seh E [fGus) | <2hen = 2 6-20), 
7=0 @o(x;) 


where the sum 2, includes all inner and some boundary cells of the 
given division. 
Let us now assume that 
g1(s) 


[f@0o=FW) <x <b, 
@2(x) 


so that F (x) is a continuous function of x in the interval (a, 4) (see 
theorem 4§ 109). The last inequality can then be written in the 
form 


< 2e(b — a). 





n—1 
YF Ente) Ae — YF (e:) in — 23) 
1 
i=0 
But the sum 
n—1 b 


YE FG) en 2d > [Fo a 


as h —-> 0; we can therefore right from the beginning take A so small 
that this sum should differ from the integral 


b b  94(x) | 
[ ria =| [ #02) & bas 


pe(x) 


by less thane. The last inequality gives us : 


b 
Po s€na) de—[ Pd! <el+26-a1 ©) 
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Finally we see that all cells of the described division T have 
diameters less than 5 and therefore the inequality (1) holds. But it 
follows from (1) and (5) 

b 


1— | F@a&| <2 + 0-0). 


Since ¢ is as small as we please and the left-hand side of the last in- 
equality does not depend on ¢, it is equal to zero and we obtain : 


1(x) 
[freneo=[ {[ranat a (6) 
D a (x) 


This is the result at which we were aiming. We thus see that 
a double integral of a continuous function can be evaluated by means 
of two successive simple (single) integrations. On the right-hand 
side of formula (6) the inner integral is constructed in the way des- 
cribed in § 109 : the variable x plays the part of a parameter in this 
integral, 7.e., it retains a constant value during integration ; not only 
the integrand but also both limits of integration depend on this para- 
meter x. Hence the inner integral as a whole is a continuous 
function of the variable x and must therefore be integrated with 
respect to x from a to b. 


It is obvious that the coordinates x and y are completely 
equivalent in all these arguments, and we can, if for some reason it 
is more convenient, integrate first with respect to x and then with 
respect to _y; for this purpose we must select points on the contour D 
at which the ordinate assumes its least value y = ¢ and its greatest 
value y = d 5 these two points divide the contour into two parts — the 
right-hand side whose equation is x = , (y) and the left-hand side with 
the equation x = ),(y). We thus obtain as above: 


[ [renee =f { [redler (7) 
D c bel») 


Evidently it is not always easy to perform the two necessary 
simple integrations. However, in principle we have converted evalu- 
ation of a double integral into a problem which we have already 
studied and we can therefore regard our problem solved. Further, 
having at our disposal two equivalent formulae (6) and (7) we can, of 
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course, in each case choose the formula which is most convenient for 
our purpose; this choice depends on the nature of the function f (x, ») 
and the form of the region D. 


Example. The trihedral prism whose generating lines are parallel 
to the O-axis, has its base in the YOY plane in the form of a 
triangle with vertices at the points A (0, 1), B (1, 0), C(— 1, 0). Find 
the volume of part of this prism confined between the plane XOY 
and the parabolloid of rotation z = x? + y? (fig. 78). 





We evidently have here a cylindrical body of the kind consi- 
dered in § 115. Here the base ABC of the prism is the region D as 
shown in fig. 79. ‘The equations of the straight lines AC and 4B are 
respectively 


e=y-1, x= 1l—y; 
we therefore obtain the following expression for the required volume 
1 1-y 
V= {{ (x? + y") dx dy -| | (x? + 9’) dxtdy, 
D 0 y= 
Here the inner integral is 


i 
3 41- ‘ 
| (x?-+ 9?) de=| stats |? =2/?(1—y) + 3 (1), 
y-t : 
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and we obtain: 


eo 


V = foxd— +80 hw 


Further calculations present no difficulties. 


For further useful exercises ¢f Problem Book by B.P. Demido- 
vich, Section VIII, Nos. 7-15, 17, 23. 


§ 118. Substitution of variables in double integrals 


We already know the significance of transformation of the vari- 
able of integration in evaluation of simple (single) integrals (we only 
need to remind you of the rationalisation of integrals of irrational 
and transcendental functions carried out ina large number of examples 
in chapter 17 where whole classes of functional dependencies were invol- 
ved). Owing to the great freedom of choice of transformations we 
are able to replace in most cases the integrand by another simpler 
expression which can be integrated more readily. 


We must now develop a similar method for double integrals. 
We shall see that here a simple method for transformation of the 
variables of integration is also possible and this frequently facilitates 
evaluation of the integral. 


Let us assume that we are given the double integral 


{J S (x, 9) dx dy, (1) 


D 


where the function f (x, y) is continuous in the closed region D. 


Let us consider, apart from the x y-plane, another uv-plane and 
a region D’in that plane. Let the transformation of the variables 


x = x (u,v), y = py (4, 2d), (2) 


where the functions x (u, v), y (u, v) are defined continuous and have 
continuous partial derivatives in the region D’, transform this region 
into the region D in the « y-plane (as considered in detail in § 105). We 
shall assume that the transformation of the region D’ into the region 
D, as effected by the relations (2), is 1—1 i.e. that every point (x, y) in 
the region D can only be transformed into a single point (uv, v) in the 
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region D’; that point (u,v) is given by the ‘‘reciprocal”’ transfor- 
mation 


“=u (x, 4), v= 2 (x, 3); (3) 


in which we also assume that the functions w (x, y), v (x, _y) are conti- 
nuous and have continuous partial derivatives in the region D. Since 
in this case (ef. § 105) 


Dur) D (x, 9) 


Dixy) D(uoy 





therefore both determinants are non-zero in the corresponding regions. 
We want to express the integral (1) over the region D inthe x y-plane 
by another double integral over the region D’ in the uv-plane. 


For this purpose we shall consider the division 7 of the region 
D effected by two families of straight lines parallel to the OX and OY 
axes ; let the distance A between two adjacent lines be the same for 
both families of lines so that the inner cells of the division J are 
squares with side k. This division corresponds to a definite division 
I’ of the region D’ whose cells will, in general, have curvilinear con- 
tours. Let us take an arbitrary inner cell (square) A; of the division 
T in the region D with vertices at the points (xz, 9x), (wx + A, Dx) 
(Xan 22 + A), (xn + hyo 4+ A) 3 this cell will, in accordance with the 
transformation (3), correspond to another cell A’, of the division T’ 
in the region D’. Let us first show that each cell is a measurable 
figure. 


The contour of the cell a’; can be divided into four parts in 
relation to the four sides of the square A,*). Let us consider one of 
these four parts, for example the part corresponding to the side 
Xn <x + yy = 3; of the square A; This side can evidently 
be expressed by the parametric equations 


Su 77) 0 Se Dy) OS OS ee PR, 


where the derivatives 9 u/0 x and @ v/d x are continuous in the inter- 
val (x;, ¥;,-+ A) and cannot vanish simultaneously, since otherwise the 
determinant D (wu, v)/D (x, y) would also vanish, as we see, is impos- 





*Here and latter in order to give a strict theoretical basis to our arguments we 
should show that in a 1—1 and mutually continuous transformation of one region 
into another the boundary of one region is transformed into that of the other 
region. This proposition is true but its proof lies beyond the scope of our course, 
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sible. Since the same also holds for each of the three remaining sides 
of the contour of the cell A ;, therefore, in accordance with theorem 
7 § 144 this cell is a measurable figure. 


In § 105’ we have seen that the ratio A’,/A x of the areas of 
two cells has as its limit the absolute value of the following determi- 
nant for h > 0 


Anr= i Di (x, 9) Ax +0 (Ax)- 
Therefore, conversely 
| 
= [a> AE re As 4 
Ak D (u, v) Aint %r Any (4) 


where «, — Oas A-> 0 and Ostrogradskij’s determinant should be 
taken at the point [u, = u (xp, pe), Ue = Y (Xp, Je)] in the cell A’x. 
Let us multiply the equation (4) by f (xs, 7%) and sum it over all cells 
of the region D: 


Yo (ee 24) A; = 


Dil 9) 4 
D ca Ant Yo Om 8) Oy Ake (5) 





ae YS Ge Dx) 





Let us now decrease the number A indefinitely and hence also the 
greatest diameter h 4/2 of the cells A; of the division T. It follows 
from the final theorem of § 116 that the left-hand side of the equa- 
tion will have the integral (1) as its limit. Let us investigate the 
right-hand side and begin by considering the second term. We have 
seen in § 105 that the numbers «, tend to zero uniformly with respect 
to the position of the square A, in the region D as h + 0; therefore 
no matter how smalls > 0 and provided / is sufficiently small we 
shall have | % | < <¢in all terms of the sum S$, f (x4, 95) % Ay and, 
therefore, provided A is sufficiently small: 


| 2a Ff (terre) %e An | <2 Dy | f (ee re) | An < wed, 


where p deriotes the upper bound of the function | f (x, y) | in the 
region D. Since ¢ is as small as we please, therefore as h > 0 


lim 3a f (x4; Je) Mp An = 0. 
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Let us finally consider the first sum on the right-hand side of the 
equation (5). Assuming, for the sake of brevity, that 

D (x, 9) 

D (u, v) ee) 


and noting that 


Ny = X (uz, Ur), De == J) (Uns Ug), 


we can write this sum in the form 


Saf {x (ee Ue), » (Ue, Px) | F (tes Ue) | Aes (6) 
where the sum extends over all cells A’, in the region D’ which cor- 
respond to inner cells A, in the region D. But asa result of the 
transformation (3) the contour of the region D is transformed into 
the contour of the region D’ and vice versa (see footnote, p. 585). It 
therefore follows that inner cells of one region should correspond to 
inner cells of the other region and the same holds for boundary cells. 
The sum (6), which is extended over the cells of the region D’ corres- 
ponding to inner cells of the region D, must therefore be extended 
over all inner cells of the region D’. Ifh-> 0, the greatest diameter 
of these cells (as a result of uniform continuity of the functions 
u (x, y), v (x, .y)) tends to zero and, as a result of the last theorem of 
§ 116, the sum (6) has as its limit the double integral *) 


[ [rte Ce 9 (uJ 1 Flu ob | de a (7) 
ut 


Hence returning to the relation (5) and taking its limit for h>0 
we obtain the formula 


[ [reso drdy =f PF Go) 7G MIF Ml dude, ©) 
D D’ 


where 

Oe oe) 
( Qu ¢u- 
J (uv 

4709! 

Qu Gu | 
and where D’ is a region in the uv-plane which is transformed into 
the region D in the xy-plane by the transformation x = x (u, 2), 
y =¥y (u,v). This is the formula for the substitution of variables in 





*) We do not prove here that the region D’, like the region D, is a measure- 
ble figure 
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double integrals which we were trying to obtain. We can see that it 
is analogous to the corresponding formula for the substitution of the 
variable in simple (single) integrals 


b 


8 
| S (x) dx = {fle (t)]o’(t)dt, 


a 


where the interval a <x<b is transformed into the interval 
a <¢< 8 by the transformation x = 9 (t). The derivative 9’ (é) 
corresponds to the determinant 7 in formula (8) or, more strictly, to 
its absolute value. As with simple integrals the main purpose of 
formula (8) is the transformation of integrals into forms more suitable 
for calculation; however, a new factor is involved here which has no 
parallel to single integrals: the use of formula (8) often involves not 
only simplification of the integrand but also effect the form of the 
region of integration; if the form of the region D’ is simpler than 
that of the region D, then the integral will itself be greatly simplified 
and this simplification is so important that in order to achieve it, it 
is in some cases even desirable to complicate the integrand a little. 


Example. The most frequent type of transformation of varia- 
bles in a double integral is the transition from rectangular coordi- 
nates (x,y) to polar coordinates (r,@); in the simplest cases the trans- 
formation formulae are as follows: 


x=rcose, yp=rsing, 


and therefore 


3 D (x,9) cos @ — rsing@ 
D (7, @) | sin © r COS © 





— ey 0 





The general formula has the form 
| [Fe y) dx dy = | | Flreose, rsing| r dr do. (9) 
D D' 


This formula is particularly convenient in case the region D is a circle 
with centre at origin: 


ey ees (10) 


it is evident that in this case the region D’ is a rectangleO <r <a, 
0 <9 < 25. It is obviously much simpler to integrate round a 
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rectangle than round a circle; the reduction to‘ two simple integra- 
tions as considered in § 117 gives for a circle (of the variables x, 7) 
the following limits of integration 


a V a?—x2 


=. 


sa’ = /78a33 


and for a rectangle (of the variables 7, ») it gives constant limits: 
a 2x 
00 

which in many problems considerably simplifies calculations *), 


Let us assume, for example, that we want to evaluate the 
integral 


r=[ fee dx dy, 
D 


where D is the circle (10). Formula (9) gives: 
I= [ [ert rdray, 
dD’ 


where D’ is the rectangle 0 <r <a, 0 << 2z. It therefore follows 
from the results of § 117 that 


=n (1 —e7 4). 





The reader should try to evaluate the same integral in rcctan- 
gular coordinates when he will encounter considerable difficulties. 


For further exercises cf. Problem Book by B. P. Demidovich, 
Section VIII, Nos. 34-36, 39, 40, 47, 49, 51, 53, 54, 86, 87. 





*) The fact that Ostrogradskij’s determinant vanishes at the centre of the 
circle does not effect the validity of formula (9) as can readily be shown, 
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§ 119. Triple integrals 


In the last few paragraphs we had occasion to observe that the 
transition [from simple integrals to double integrals necessitated a 
detailed study of the region of integration, z.e. we had to use the 
theory of measurable figures, in spite of the close analogy existing 
between these two types of integrals. The construction of the theory 
described in § 114 required considerable effort; however, this effort 
is amply rewarded by the simplicity and accuracy of the subsequent 
construction of the theory of double integrals; it is even more 
important to note that § 114 can entirely and almost without modi- 
fications be extended to measurable sets in space of any number of 
dimensions and that, consequently, the theory evolved in this para- 
graph can serve as the basis for integrals of any multiplicity. 


In order to construct the theory for measuring sets in a three 
dimensional space we must follow the definitions and arguments of § 114 
step by step; the necessary changes evidently involve the replacement 
of nets of straight lines by nets of planes, 2.e. parallelograms are 
replaced by parallelopipeds, circles by spheres, etc; however, the 
arguments of § 114 are essentially preserved without modifications. 


‘The triple integral 


{f SF (x, 9, 2) dx dy dz, 


V 


where V is an arbitrary bounded measurable set in the three dimen- 
sional space and f(x, 7, z) a function defined in the region V, is said 
to be limit of the sum 


Y fee tks Cn) Ak 


which extends over all cells A, of a division T of the region V, where 
(En. Gx, Gy) is an arbitrary point in the cell A, ; this limit is taken on 
the assumption that the greatest diameter of the division T tends to 
zero and is independent of the effected division T and choice of the 
points (Cz, 4%, Cz) in the cells of these divisions. 


§ 116 can be extended to triple integrals without alterations. 
The practical evaluation of a triple integral is usually carried out by 
replacing a triple integral by three successive simple (single) integ- 
rations as we have seen in $117 for double integrals. Thus we obtain 
for regions of sufficiently simple form 
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or(x) dalx, 7) 


(If S(x,y, 2) dx dy dz 2 | [ | S(% 9s Z) dz |b tds. (1) 
iv 


a a(x) Ue(x, 7) 


The inner integral is here taken with respect to z while x and » are 
parameters; the limits of this integral represent respectively the upper 
and lower bounds of values of z in the region V for given x and y; 
therefore the inner integral (in square brackets) is a function of x and 
y; this function is subsequently integrated with respect to y where x 
is 2 parameter; the limits of this integration are the bounds 9g, (x) 
and 92(x) of » in the region V for the given value of «; a function of x 
(placed in crooked brackets) is obtained as a result of this second 
integration ; finally (the third integration) this function is integrated 
with respect to x, where the limits are the bounds of x over the 
whole region V. It is evident that the above order of integration 
can be replaced by any other order (with corresponding changes 
of limits of integration) and this freedom in the order of integration 
should be used in each case to simplify the whole sequence of ope- 
rations, 


If we denote the inner integral on the right-hand side of 
formula (1) by (x, »), then the right-hand side as a whole can be 
written in the form 


b ertx) 


® (x, 9) wt dx, 
a @aix) 


which, according to § 117, is equal to 
[[ eo, raed, 
D 


where D is the projection of the region Von the XOY-plane. Formula 
(1) therefore gives us: 


dy(x. 9) 


II] St (%, D5 ated d= || | S(% I, 2) de fd dy. (2) 


delx, 7) 


We thus see that triple integration can be replaced by the successive per- 
formance of one single and one double integration. 


In order to get used to the quick evaluation, from the given 
geometrical region of integration V of the limits of all three simple 
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integrals on the right hand side of formula (1) and also to the solution 
of the converse problem determination of the form of the region V 
from the given limits of the simple integrals, considerable practice 
isnecessary. ‘Therefore good manuals on integral calculus contain 
many examples of this kind which are characterised by the fact that 
their solution not only involves integrations of any kind but even the 
type of the integrand must necessarily be known. 


Finally the formula for the transformation of variables, which 
is analogous to formula (8) § 118, also holds for triple integrals. If 
the transformation 


u=u(x,y, Zz), o= 0(x, 7, Zz), w= wx, y, 2) (3) 


maps 1-1 the region V in the xyz-space into the region Y’’ in the 
uvw-space, then, provided the usual requirements of continuity and 
the condition 7 4 0 are preserved, we have; 


II] f(x, 9, 2) dxdydz = 


= {| | Slelu, v, w), yet, 0, w), zl v, w)]| 7] du do dw, 
Vv‘ 


where 


Dix, yz) _ |opopyay 


I=Du, v,w) | eu ev ew 








is Ostrogradskij’s determinant of the transformation 
“= x(u; vy; w), yp = y (u, a; w), aS Z(u, 2) w), 


which is inverse of the transformation (3), The deduction of this 
formula (which we shall not attempt here) is carried out in close 
analogy to the deduction of formula (8) § 118 if we see in advance 
that in the three-dimensional case (as in the two dimensional case) 
the absolute value of Ostrogradskij’s determinant can be interpreted 
geometrically as a specific “coefficient of expansion” in the transfor- 
mation of infinitely small bodies. : 
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As in the two-dimensional case, one of the most frequent types 
of transformation of variables in a triple integral is the transition 
from rectangular to spherical coordinates : 


x = rcosecosy, 

y = r cosesiny, 

Z=rsing, 
where 


0<cr<+oa, — 


We readily obtain: 


D(%, 9, 2) | 
Dr, 9, b) | 


and the transformation formula takes the form 


(I S (x, 9, 2) dxdydz = 


ie 


= r? cos, 


= {\) f(rcos? cost, r cosesiny, rsin 9) r? cos 9 drdo dv. 


This transformation is usually most convenient if the region of 
integration is initially the sphere 


wre ee Ze aes 
and if the region V’ is the rectangular parallelopiped 0 <r <a, 
sem De, Poe 260 Se 2 a 


For exercises to § 119 cf. Problem Book by B.P. Demidovich, 
Section VIII, Nos. 148—150, 158, 159. 


§ 120. Applications 


In this paragraph we shall briefly consider several applications 
of double and triple integrals to geometrical and statical problems. 


J. Area cf a surface. The area of a given part of a curved 
surface can only in a few isolated cases be solved with the help of 
elementary geometry. In general, this problem involves the methods 
of integral calculus. We shall see that the part played by a double 
integral in the solution of this problem is analogous to that played 
by the usual integral in finding length of an arc of a curve (§ 52). 
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Let us assume tha: we are given a part of curved surface which 
is intersected only at one point by a straight line drawn in a given 
direction which we shall take as the direction of the OZ-axis. This 
part of the given surface can be expressed by the following equation: 


z= f(x 9), (1) 


where we assume that the function f(x, y) is continuous and has 
continuous partial derivatives with respect to x and ». Let the 
projection of the given part of the surface (1) onto the YOY-plane be 
a measurable figure D. ; 

We known (§ 99) that with the assumptions made with regard 
to the function f(x, »), the surface (1) has a tangential and a normal 
plane at every point of the given part; if we denote by Y the acute 
angle between this normal and the OZ-axis, then 

z (2) 


Af 1+ (2) 4+ (= - 

cx oy 

As usual in geometrical applications of matheinatical analysis 
our problem ‘involves the definition of area of a part of a curved 
surface after which we must evolve an apparatus for the evaluation of 
this area. For this purpose let us divide the region D arbitrarily by 
the divison 7 into cells for which we shall only demand that each 
cell must be a measurable figure and no two cells should have any 
common interior points. Let us select an arbitrary point (2, -4;) in 
every cell A;, and draw a perpendicular from this point to the XOY- 
plane to intersect the surface (1) at the point M4; (2x, qx, Cz), where 
Cu = fléx, m’. Let us draw a tangential planc to the surface (1) at 
the point M,. In the neighbourhood of the point M,, the course of 
this tangential plane is close to the course of the surface (1) itself; 
hence this visual representation shows us directly that, provided the 
diameter of the cell Aj, is very small, the measure s, of the part of the’ 
surface (1) projected onto the cell A; should be very close to the 
measure o, of the drawn tangential plane projected onto the same 
cell. Summing this approximate equality over all cells we conclude 
that, provided the diameters of the cells are small, we are justified in 
taking the measure (area) of the whole part of the surface (1) in which 


~ 





cos ¥ =- 


we are interested (this mcasure is equal to > 5,;) as being close to the 
k 


eae (3) 


k 


sum 
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therefore if this sum tends to a definite limit when the diameter of 
the cells become infinitely small, we naturally take this limit as the 
measure (area) of the part of the surface (1) in which we are 
interested. 


We shall now show that if the division 7 becomes infinitely 
fine, the. Jimit of the sum (3) always exists irrespective of the per- 
formed division and choice of the points (&;, qx) in the cells A;. Let 
us note the meaning of the quantity o,. We have chosen an 
‘arbitrary point (2;, 7, in the cell A, and assumed that f(E,, 4,)=Cr3 
we have also drawn a tangential plane to the surface (1) at the point 
My, (Ens ‘Ges Cr)} ©, Aenotes the measure of that part of this surface 
whose projection into the XOY-plane is the cell A;. Since the angle 
between thcse two planes is evidently equal to the angle Y as 
considered above, therefore, in accordance with the general law 
connecting the area of projected figure and that of the projection*) 
we must have: 


Ax; = Go, COs Y, 


where the angle Y is obviously takcn for the point AZ;, ; therefore as 
a result of (2) 


and; consequently 





ko i) iz 


vv 


Vor=} VIFF Ew ty) tS 
k k 
But this sum has exactly the same formas thesum consideredin § 116; 


in accordance with the assumptions made with regard to @f/dx and 
afiay in agrcement with the results of § 116 it therefore follows that 





*) “The area of a projection is equal to the area of the projected figure 
multiplicd by the cosine of the angle between the two surfaces in question”, 
This rule is proved in elenientary geometry for figures whose areas can be determined 
within the scope of this science. We have applied this rule to a more general case. 
In fact, we make use of the following proposition: “ifthe projection of the given 
figure is measurable, then the figure itself is measurable and the measure of the 
projection is equal to the measure of the projected figure multiplied by the cosine 
of the angle between thc two surfaces in question”, ‘This general rule follows 
directly from the above rule of elementary geometry but we cannot go into this 


q uestion in greater detail, 
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the sum under consideration tends to the following integral asits limit 


when the division T becomes infinitely fine: 





Ss I]/ 1+ (LY + GLY eee 


which, according to the accepted definition, must be regarded as the 
expression of the area S' of the part of the surface (1) in which we are 
interested. All necessary requirements concerned with the indepen- 
dence of the limit obtained from the elements of construction (i.e. from 
the choice fof the divisions T and the points (€;,%,) in the cells) 
follow directly from the general theory of double integrals (§ 116). 


It is interesting to compare (4) with the formula 


b 
rae \2 
b= [af 1+(B) @ 
a 


(4) 


which expresses the length Z of an arc of a plane curve y = f (x) 
confined between x = a and x = 6 and note the close analogy between 


these formulae. 


Example. 


Find the surface area of a sphere of radius a. 


Let us 


place the origin of a rectangular system of coordinates at the centre 
of the sphere so that the upper hemisphere is expressed by the 


equation 


£=f/e@— — yp; 


let us take the equatorial circle 17 + y? = a? as theregion D. 


readily obtain : 


therefore 


1+) + GY = 


and formula (4) gives us the area of the hemisphere : 


Bi 


Se ye 





We 


af a — x? — yt ? 


\ 
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or, changing to polar coordinates (v = rcos 9, y = rsin 9) 








af art 


a a a 
, 0 
=a {ee |e] == =2ra(./@—r*) | 272", 
0 0 0 : 


S=4ra 
this formula is well-known from elementary geometry. 


For further exercises cf Problem Book by B.P. Demidovich, 
Section VIII, Nos. 107, 109, 110, 118. 


The established concept of area of a surface has the disadvan- 
tage that it depends on the chosen system of coordinates (7.e. on the 
choice of plane onto which the given part of the surface is projected). 
We could show directly that this dependence is only imaginary (i.e. 
the area remains unchanged even if we alter the direction of pro- 
jection provided the part of surface is only intersected at one point 
by every projected straight line) ; alternatively, we could replace our 
definition, by another, a more complicated definition which would be 
completely free from all arbitrary elements. However, both these 
methods are too complicated to be considered here. 


If the part of the surface whose area we are trying to find does 
not permit the expression of one of its coordinate axes as a single- 
valued function of the two other axes (such is, for example, every 
closed surface), then it is frequently possible to divide this part into 
a finite number ofsimpler parts so that such an expression is possible 
(in general, it is necessary in such cases to choose different directions 
for the projection of individual parts). ‘The area of the whole part is 
then equal to the sum of the areas of the constituent “‘simpler’’ parts. 


2. Integrals over parts of surfaces. In § 52 we have defined 
the llength of an arc of a curve and introduced the concept of an 
“integral along a given section of acurve”. Similarly, having defined 
the area of a part of a curved surface, we can use the concept of 
“double integral over the given part of the surface’? which is naturally 
a generalisation of the usual double integral over one or other plane 
region. 


Let S be a part of a surface of the type considered at the end of 
example 1 and let (x,y, Z) a continuous function in a region in 
space which contains the part S within itself. Let us divide the part 
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S arbitrarily into cells, each of which has a definite area and choose in 
every cell c;, an arbitrary point (x, 9'z, 2%). Ifthe sum 


y} F (tan Dis Zn) Oo}; 
& 


tends to a definite limit when the division becomes infinitely fine (7.e. 
when the greatest of the diameters of the cells tends to zero) and if 
this limit is independent of the performed divisions of the part S and 
choice of the points (x, 7, Z,), then we say that this limit is double 
integral of the function F (x,y, z) over the given part S of the surface and 
denote it by 


{| F (x, 9, z) do. 


Ss 


This concept has many applications which are similar to those 
of an integral along a given section of acurve. In § 54 we have used 
this integral to express the mass of a material curve whose density of 
which at every point is known. Problems involving mass, electric 
charges, etc. on material parts of surfaces are solved in the same 
manner. Let us consider, for example, a charged electric conductor 
whose charge is distributed over its surface with a (surface) density 
¢ (x,y, <). The reader will have no difficulties in showing for himself 
that the part S of this surface will have a charge equal to 


IJ P (x,y, Z) do. 


3. Mass of a heterogeneous body. As the simplest example of 
the use of a triple integral let us determine mass of a heterogeneous 
physical body with refererce to its density. If the given body is 
homogeneous, 7 ¢. its density 9 is the same at every point, then its mass 
M is equal to the product of the density p and the volume of the body 
V. Ifthe body is heterogeneous, then its density p = p (x, _y, z) is different 
at different points. Let us divide the given body arbitrarily into cells 
and let d (7) be the greatest diameter of a cell of the given division T. 
Let us take an arbitrary cell Aj, and select an arbitrary point 
(En; Gry Cx) in it. We shall assume that the function 9 (x, y, z) is 
continuous within the given body. If the diameter of the cell A , is 
very small, the values of the density e at different points will be very 
close to one another and also close toe (Ex, 42,62). It is therefor 
natural to assume that the mass of the cell A ; will be close to the 
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mass which it would have if it were homogeneous and its density 
equal to e (Ex, nx, Cx), 2-€. it will be close to 


© (Ens Nes Sx) Ans 


the mass of the whole body should be close to the sum 


y) p (E es Nk Cr) A ks 
k 
taken over all the cells of the body. But we know from § 119 that 


this sum tends to a definite limit as d(T) + 0 which we can denote 
by 


({] e (x,y, z)dx dy dz, 
V 


where V is a region in the three-dimensional space occupied by the 
given body. We naturally take this limit as the expression of the 
mass AJ of the given body : 


M =||| e (x, 9, z)dxdy dz. 
V 


4. Coordinates of centre of gravity and moments of inertia of a 
body. The apparatus of double integration enables us to find easily the 
coordinates of centre of gravity and moments of inertia of plane 
plates while the apparatus of triple integration enables us to do the 
same for bodies in space. We shall only consider bodies in space, 
since the arguments and results for plane plates are exactly the same 
as those which we shall obtain in the three dimensional case. 


We shall again divide our body into cells with small diameters 


and choose an arbitrary point (@;, 7, C,) in each cell Ay. IPf we 
replace each cell A; by a material point with the mass 


p Gs Qiks Cr) Ax 
situated at the point (€;,7%.%,¢,), then the given body will be replaced 
by a system of a finite number of material points whose statical pro- 


perties will be close to the given body. For such a system of material 
points the coordinates of centre of gravity will be as follows : 


ye - (én, Gis Cr) Ax Vu P (Ens Tks Cr) A Kk Vo. (Ens Nk» Cn) A k 
E k k 





3 ~ oy m Fs * 
Yee, hes Sr) Ak Vio Ens Tira Cr) Ar Ve (Ex, Ns Ce) Ax 
k 
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Therefore we naturally take the limits X, y, z of these three expressions 
for d(T) — 0 as the coordinates of centre of gravity which are respec- 


tively equal to 


[Jee dn Oiee [[Joet22 \dx dy dz 
V 


- {ff p ee ys Seo aif Ols9), 2) ax ae 2 
V 








(\f zp (x, », 2) dxdydz 


a {ff etx, y, z) dxdydz 
V 


or denoting by M the mass of the given body 


— 1 — 1 
x= aif xedxdydz, y = ial || veeravae, 
V V 


= 1 
zZ= alll zPdx dy dz 
V 


(where for the sake of brevity we write P instead of pe (x, _y, z) under 
the signs of the integrals). In particular, if the given body is homo- 
geneous (2.¢. pe is constant throughout the body), then M = eV and 


— 1 - 1 
— l{{ xdxdydz, y = alll ydx dy dz, 
V V 
z= aff dx dyd 
=F zdx dy dz. 
V 


Let us now consider moments of inertia of the given body and 
again begin with the replacement by the approximate system of a 
finite number of material points as described above. For such a 
system moment of inertia with respect to the XOY-plane will be: 





, 08.0 (Exs Mes Cn) Ar 
k 
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and slmilarly for the two other coordinate surfaces (planes). The 
moment of inertia with respect to the OX-axis will be: 


y (475 + Ox) e(Exs Ter Se) An 
k 


and similarly for the other two coordinate planes. Finally moment ° 
of inertia of the approximate system with respect to the origin O of 
coordinates will be: 


Using the same arguments as those used in finding the coordinates of 
cenue of gravity we find that moment of inertia of the given body 
with respect to the XYOY-plane is equal to: 


May = {ff Zo (x,y, 2) dxdydz 
V 


and similarly for the other two coordinate planes. Similarly moment 
of inertia of the given body with respect to the OX-axis is equal to 


2 = {| | (2? + 9?) 0 (xy, z) dx dy dz. 
v 


Finally moment of inertia of the given body with respect to the 
origin O of coordinates is equal to: 


M, = II} (x? + 9? + 2?) (x, 9, ) dx dy dz. 


For exercises cf. Problem Book by B.P. Demidovich, Section 
VIII, Nos. 191, 193, 200, 201. 


CHAPTER XXVITI 
CURVILINEAR INTEGRALS 


§ 121. Definition of a plane curvilinear integrai 
In chapter 26 we have studied integrals of the type 


° 


b 
| fl3) dx 


where the variable y is a parameter, i.e. it remains constant during 
integration. Direct generalisation of the part played by the variable 
y will be the case when, within the limits of integration (7.e. when 
a<x <5),» is given as a function of x,y = 9(x), so that the 
integrand becomes f[x, © (x)]. If, as we shall assume, the functions 
J (x, 9) and @ (x) are continuous in their corresponding regions, then 
the function /[x, 9 (x)] will also be continuous in the interval a<x <b 
and there is no doubt as to the existence of the integral 


t 


b 
[fs ¢@l ax (1) 


Let us denote the beginning and end points of the curve y = ¢(x) 
in the interval (a, 6) respectively by A and B (fig. 80). In this case 
the integral (1) is called a curvilinear integral of the function f(x, y) with 
respect to x along the curved interval AB and denoted as follows: 


[ Fos) dx ; (2) 
AB 


this notation unplies that y should be replaced by the function of x 
whose graph is given by the curvilinear interval AB. Thus if y 


602 


‘ 
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retains the constant value 7) during integration (the case of an 
integral depending on a parameter), then the integral (2) is taken 
along the rectilinear interval y = )9(a@ < x < 6) and the coordinates 
of the points A and B are respectively equal to (4, yo) and (4, 9). 


This concept of curvilinear integral along an interval of a plane 
curve evidently contains nothing new apart from the fact that we 
agree to denote the integral (1) by the symbol (2). We must draw 
attention to the fact that in this notation the direction (from A and B) 
on the curve AB is important; in fact it follows from the definition 
of the symbol (2) that 


a b 
[ fes2de = [sts etwide= — | fs Wer = 
BA b a 


= — | fee, 
AB 


i.e. if the direction of the curve along which we integrate changes, the sign 


of the integral is reversed. 


This initial definition of a curvilinear integral has very limited 
applications, since very restrictive conditions are placed on the 
interval AB, i.e. y must remain a single- 
valued function of x along the course of , 
the curve (or, speaking geometrically, any 
straight line parallel to the OY-axis must 
intersect this interval at one point only); 
in practice one must often integrate along 
interval of much more complicated form; 
thus in many problems of mechanics and 
physics it is important to integrate along @i a 6 4 
simple closed curves which, of course, do not Fig. 80. 
satisfy the above conditions of the simplest 
case. We must therefore try to evolve an analytical instrument 
which would enable us to extend the concept of a curvilinear integral 
to a wider class of cases. 





Let us then return to the simplest case considered above and 
assume that the function 9(*) represented by the curvilinear interval 
AB is not only continuous in the interval (a, 6) but also has a conti- 
nuous derivative in that interval. Let us divide the arc AB into 
subintervals (“cells”) by the points of divirion Aj, 4g,-.-,4, and denote 
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the length of the subinterval A; A, of this curve by A;. We know 
(§ 52) that A; can be expressed by thc integral 


“Ie 
wea iescore 
*K~1 
where 2,1 and x; are respectively the abscissae of the points 4;,-, and 


A, on the curve AB. According to the mean-value theorem we can 
therefore write 


Ae = V bt +0? (&) Aa (3) 


whcre Ay = *,; — Xpz-1 and %, is a point in the subinterval (%;,-3, \,)- 
We also note that since 9’ (&,) is the tangent of the angle «, made 
by the tangent to the curve AB at the point x = £, and the positive 
‘direction of the OX-axis, therefore 


] 


1 + 9"? (&) = sec? og = bore 


and the relation (3) gives: 
Ay COS & = Any 


where we must take cos 7, > 0 which implies that «, i.e. the angle 
between the tangent and the OX-axis, is acute, (or, which is the same, 
we must direct the tangent towards increasing values of x). This 
choice of direction of the tangent is necessary if we want A; cos «, to 
have the same sign as A; since, in accordance with our assumption 
that a < 6, we have Ax = x; — X%p-4 > 0. If we had a > 4, then 
we would have A; < 0 for every &; hence the preservation of the 
relation A; cos o, = A; demands that cos a, < 0; therefore in this 
case the angle «, must be acute, 7.e. we must direct the tangent 
towards decreasing values of x. Hence in all cases the direction of the 
tangent must be chosen in relation to the movement along the curve Srom A to 
B, regardless of whether this movement takes place from left to right 
or from right to left. 


Let us now construct a sum Sens over all cells 


, F Ens tix) C08 tty «My = Ee Ee te) Avs (4) 


where in each term 4, = ¢ (&). We shall make the division of the 
interval AB sufficiently fine so that the greatest length A; (and hence 
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the greatest length A;,) should tend to zero. Since, in accordance 
with our assumptions, the function /[x, @ (x)] is continuous in the 
interval (a, 6), therefore the right-hand side of the equation (4) will 
tend to the following integral as to its limit: 


b 
[ sb. ? (x)] dx, 
a 

which we agree to denote by the symbol 


[FG52) ax 


AB 


and call as curvilinear integral of the function f (x, y) along the curve 
AB. Hence the left-hand side of the equation (4) also tends to this. 
limit, z.e. we have: 


| f(o9) dx = lim YF (Ee, @ Es] cos ay « Ay (5) 
AB k 


If, in general, we agree to denote by « = « (x, 7) the angle 
between the tangent at the point (x, y) to the curve AB and the posi- 
tive direction of the OX-axis, we shall have a, = « (&, yx); the sum 
on the right-hand side of the equation (5) can then be written in the 
form 


y} f (ee Ti) cos & (Ex, Nx) : Ax aes y. PF (an %r) Ns 
k k 


where F [x, o (x)] = f[x, @ (x)] cos « [x, @ (*)] is a continuous func- 
tion of x in the interval (a, 6). But, as a result of our assumption on 
continuity of the derivative 9’ (x), the curve» = 9 (x) can be exten- 
ded along the interval (a, 5) and for such curves the sum 


ns a (Ex Gr) Ans 
k 


where (2; 7) is an arbitrary point on the line A;, tends to a definite 
limit when the division becomes infinitely fine (§ 57); we agree to 


denote this limit by 


| F (x, 9) dA 
AB 


and call it integral of the function F’ (x, ») along the curve AB, 
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Thus in our case 


Yt 2 Gl £08 & Eas 9 (Ea)] Ae >] F (os 9) cos # (2 9) d 


AB 


Comparing this with the relation (5) we obtain: 


Ne 


\y (x, ») dx = [so y) cos a(x, y) da, (6 
AB 


AB 


The left-hand side of this equation is a curvilinear integral along the 
interval 1B in the sense defined at the beginning of this paragraph. 
‘The right-hand side represents an ‘“‘integral along the curve AB” as 
defined in § 52. The latter definition differs essentially from the 
former, for it is constructive and the integral defined by it results 
from a definite construction i.e. it is a sum of a definite form. We 
can therefore regard the relation (6) as a new constructive definition 
of a curvilinear integral. Let us note further that « (x, ) denotes 
here the angle between the positive direction of the OX-axis and the 
tangent to the curve AB at the point (a, y) drawn in the direction of 
movement from A to B \t. ¢ cos « (*%, y) > O for a <6 and 
cos % (x,y) <O fora > 4. 


So far all that was said only referred to the simplest ‘case when 
the given curve was expressed along the interval AB by the equation 
y = o(x). Hf this is not so, the inte- 
gral on the left-hand side of the equa- 
tion (6) is meaningless, for then each 
value of x on the curve AB corres- 
ponds, in general, to several values of 
y. However, the position is quite diffe- 
rent for the integral on the right-hand 
side of this equation. The construc- 
tive definition given to this integral in 
§ 52 is independent of the fact that 

Fig. 81. the curve AB can be represented by 

an equation of the form y = @ (x); it 

remains valid in more general cases and, in particular, it holds for 
all ‘smooth’? curves AB. In these general cases the direction from 
A to B in which the curve is described will, in general, no longer be 
always from left to right (or always from right to left); in different 
intervals of the curve AB this direction can vary (fig. 81) so that the 
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angle «(x, ») can be acute and obtuse and cos «@ (x, y) will be corres- 
pondingly positive and negative. For the integrand on the right-hand 
side of the equation (6) we draw, as before, a tangent from 4 to B in 
order to define the angle « at every point. 


These considerations naturalJy lead us to define a curvilinear 


integral 


[s (x, y) dx 


AB 


by the equation (6) in all cases in case the integral on the right-hand 
side of this equation exists; we have just shown that this cxtension 
of the concept of curvilinear integral enables us to integrate along a 
wider class of curves which also includes scme of the simple closed 


curves, ¢ g. circles, ellipses, etc. 


Taking the genera] definition ofa curvilinear integral as given 
by formula (6) we identify the concept of a curvilinear integral with 
the concept of an “integral along an extended curve AB” as given 
in § 52. However, this is not quite so. In fact, in our former defini- 


tion of the integral 


| F (x, y) da, 
G 


taken along the extended curve C, the integrand only depended on 
the point (x,y) on the curve C; in our case the integrand /(x, ) 
cos « (x,y) on the right-hand side of formula (6), apart from depend- 
ing on x and y, also depends essentially on the direction ofthe tangent 
to the curve AB at the point (x, ). If this direction is changed, 
cos « (x, y), and hence the integrand as a whole, reverses its sign. ‘The 
former definition of an ‘‘integral along the curve C”’ is independent 
of the direction in which the curve C is described; in fact, according 
to this definition, the choice of this direction is quite irrelevant for 
this integral. For the integral on the right-hand side of the equation 
(6) the -position is quite different. Having established a definite 
direction on the curve AB, say from 4 to B, we simultancously 
determine a definite direction at every point on the tangent to this 
curve; thus cos & (x, 7), and hence the intcgrand as a wholc, receives 
a definite value at the point (x, y) and our integral becomes an “‘inte- 
gral along thecurve AB”. Uf we changc the direction along the curve 
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AB, then the integrand changes its sign at every point and therefore 
the sign of the integral will also be reversed : 


[fos2)a = — [sey ax 
BA AB 


and the reason for this difference of signs is, as we can see, due to the 


fact that formula (6) defines [ras and [sex by means of two differ- 
AB BA 


ent “integrals along the curve AB”’. 


In curvilinear integrals the curve along which we integrate is 
frequently denoted by a single letter, for example by C; but this 
notation does not show us the chosen direction on this curve and in 
such cases this direction must always be discussed, for otherwise the 
integral has no definite meaning. Thus if the curve C has ends 
A and B, it is usually denoted as AB or BA in accordance with the 
chosen direction of integration. If the curve C is closed and has no 
ends then in simpler cases it divides the plane into two parts — the 
interior and exterior. In such cases we call the direct way when 
direction of describing the curve where the interior always remains 
to the left of the path and the reverse way when the curve is des- 
cribed in the opposite direction. If the curvilinear integral is 
denoted by 


Pp) ae, 
Cc 


where C is a closed curve, then in cases where nothing is said about 
direction it is assumed that a direct description of the curve is envi- 
saged ; we shall keep to this rule in future. 


It is self-evident that all that is said in this paragraph in 
relation to integrals of the form 


[ F659) a, 
AB 
can be extended without modifications to integrals of the form 


[Foo a 


AB 
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If the interval AB along which we integrate can be expressed by an 
equation of the type 


x= 9(y) (<<a), 


we assume by definition 


d 
[Fo b= [F091 6. 


AB 


Similarly to formula (6) we then prove that in this “simple” case 


| f(%9) &y = | FO9) sin aan (7) 
AB AB 


(since for the acute angle 8 between the tangent to the curve AB and 
the OY-axis we evidently have cos 8 = sina) and we take this 
formula as the definition of its left-hand side in every case when its 
right-hand side has a meaning. It is evident that in this case the 
direction of the tangent at every point (and hence also the sign of 
sin «) is chosen in accordance with the direction of the curve AB 
itself. 


In practice one frequently meets sums of the form 


[ Poy) de + [ Qa oy, 
AB AB 


whose terms differ from one another by their integrands and vari- 
ables of integration but where the integrals are taken along the same 
curve AB. In such cases it is customary to write the sum in the form 


[ 9d + O39) db 
AB 


or, more briefly, 


(P dx + Q dy). 


O:-e=, 


It follows from the formulae (6) and (7) that 


| (P dx+ Q dy) = | (P cos a + Q sin a) da. (8) 
Cc Cc 


For exercises to § 12] ¢f Problem Book by B.P. Dernidovich, 
Section VIII, Nos. 293, 295, 299. 
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$122. Work of a plane field of force 


Curvilinear integrals find many applications in geometry, 
physics and technical problems. Before proceeding further we shall 
consider one of the most important and at the same time most 
typical examples of this kind. 


In § 45 we have already considered the work done by a vari- 
able force when a material point moves along a rectilinear path; 
we shall now consider the same problem on the assumption that the 
point moves along a plane curve. 

Let a material point situated at the point (x, y) in the given 
plane be subjected to the action of the force F whose magnitude and 
direction are uniquely defined by the coordinates x and y of the 
point at which it is situated. Thus a definite vector F which expresses 
the force acting on the material point situated at the given spot is 
associated to every point in the plane (or each part of the plane). 
The set of these vectors is known as the plane field of force defined in 
the given plane (or in a definite part of it). 


Let us now assume that the material point travels along the 
interval AB of a given smooth curve in the plane in which the field 
of force F is given. We are trying to find the work of this displace- 
ment done by forces acting in this field. In order to define a field 
of force it is very convenient to define the components P(x, y) and 
Q (x, y) of the vector (force) F in the direction of the axes OX and 
OY; we assume that these two functions are continuous in the region 
which contains the curve AB within itself. 


Let us divide the route AB of the material point into sub- 
intervals (cells) Aj, Ag,..., A, and choose an arbitrary point A;,(x,, y,) 
in every cellA,. Let F;, denote the vector (force) acting at the point 
A; and | F;,| the absolute value of this vector. Let 9, denote the 
angle between the vector F,, and the tangent to the curve AB at the 
point A; taken in the direction of motion (or, which is the same, the 
velocity vector of the moving point at the point A,). If the sub- 
interval A, has the same length but is rectilinear and follows the 
direction of the above tangent and the force acting in this subinterval 
is constant and equal to the vector F,, then the work done by this 
force in passing through the given point in the interval A; would, in 
accordance with the law of elementary physics, be equal to the 
product 


i 
|, | COS Py Aj. 
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If the cell A, is small while the vector F and the direction of the 
tangent to the curve AB change continuously as the positions of the 
given point change, then the above product gives an approximate 
expression of the work of the field done in displacing a moving point 
along the subinterval A;. And since we naturally assume that the 
work of the field along the whole length of the curve AB is equal to 
the sum of the ‘‘elementary”’ works along its individual subintervals, 
we obtain the following expression which gives the approximate value 
of this sum 


n 


y\ Fi, | cos 2, « Mxss 
k=1 


this approximation will be more accurate if the dimensions (dia- 
meters) of the cells A; become smaller. We know (§ 52) that if the 
division of the interval 4B becomes indefinitely fine, this sum tends 
to a definite limit which is independent of the divisions and choice of 
the points (x;,, ,) in the subintervals; we naturally take this limit as 
the exact expression of the work of the field along the interval AB of 
the given curve. Under these conditions we shall agree to denote 
the limit of this sum by 


| | F | coseda, 
AB 


where | F' | cos 9 denotes the projection of the vector (force) acting 
at the point (x, _») on the curve AB on to the direction of the path at 
that point. But in accordance with vector algebra the projection of 
the vector in any direction is equal to the sum of the projections of 
its components in the same direction; therefore if we denote by 
a = a(x, y) the angle between the positive direction of the O4-axis 
and the velocity vector of the moving point at the point (x, y) we 
obtain: 


| Fl cos@ = P(x, y) cosa + Q(x, 7) sin a, 


which gives us the following expression for the work of the field along 
the interval AB : 


We= { {P(x, y) cosa + Q(x, y) sin «} da, 
- AB 
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or, in accordance with formula (8) § 121 


W = | {P (x, 9) dx + Q(x, 9) dy}, 
AB 


which fully solves our problem. We thus see that the physical 
concept connected with this problem can be accurately formulated 
in mathematics by means of the general concept of a curvilinear 
integral. 


§ 323. Green’s formula 


In practice curvilinear integrals round closed curves are very 
important; in this and the next paragraphs we shall pay particular 
attention to such integrals. The regions of integration will in ali 
cases be smooth curves, i.e. curves which do not intersect themselves ; 
such curves, as we already know, always divide a plane into two 
parts — the exterior and the interior. Denoting such a contour by L 
we shall take the integral 


{ (P dx + Q dy), 
L 


as is usually accepted, to denote an integral in which the curve ZL is 
described the “‘direct’” way, i.e, such that the interior of the plane 
always remains to the left of the direction of movement (fig. 82). The 
opposite direction is called the “reverse” way. 


Let us consider a region D in the XOY-plane bounded from 
above and below by the curves y = 9, (x) and y = 9, (x) respectively 
and from sides by the straight lines x = a and x = 0 (fig. 83). Both 
straight lines (or one of these lines) can degenerate into points so that 
the curves y = 9, (x) and y = 93(x) meet atx = aand x = b; we 
shall assume that the functions 9, (x) and 9, (x) are continuous in the 
interval (a, b). Let P(x, y) be a continuous function with continuous 
partial derivatives inside and on the boundary of the region D. We 
know from the previous chapter that under these circumstances the 


double integral 
oP 
eh 
| } Oy *o 


D 
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exists and can be represented in the form 


b a 
It [Soha 
a a(x) 


The inner integration (with respect to y) is, as usual, carried out on 
the assumption that x remains constant; in this case we evidently 
have 


7) le, 9 
| oe : dy = 7  [¥, 1 (x)] si Pix, Po (x)], 
p2(x) 


and we obtain: 
Nis dx dy = foe 0, (x)] dv— | P[x, Pe («)] dx. 


In accordance with the initial definition in §121, each integral on the 
right-hand side represents a curvilinear integral of the function 


“ 


Y=9,(z} 





ee 
NO \ 
ee 
Fig. 82 Fig. 83 


P(x, y); the first integral is taken along the interval DC of the curve 
_y = 9, (x) and the second along the interval AB of the curve y=9(x). 
We can therefore write 


Ife - dx dy = ie yy dx -| P(x, y) dx = 


AB 


= — | Pix) ae | P (x, y) dx. (1) 
cD AB 
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Let us now note that integration of the function P (x, y) with respect 
to x along any one of the rectilinear intervals 4D and BC (in any 
direction) gives zero; in fact, the integrals along these intervals 
cannot be defined in the sense given in § 121, since y is not a sing!e- 
valued function of x in these intervals; but the wider definition of 
§ 121 can be applied and it gives zero for both integrals since 
evidently cos % = 0 in the whole length of each interval. 


With this in consideration we can rewrite formula (1) in the 
form 
{|< dx dy = — | Pax — [P dx — [P dx | P dx, 
D AB BC cD DA 


or 


| [= dx dy = -- | P (x,y) dx, (2) 
D ' L 


where Z is the contour of the region D which, in accordance with 
our agreement, is described in the direct way. 


Let us now imagine that the variables x and _» are interchanged 
in all the above arguments ; in that case instead of the shape repre- 
sented in fig. 83 the region D will have 
the shape shown in fig. 84. Let Q (x,y) 
be a continuous function with continuous 
partial derivatives in this new region D. 
The reader should perform all calcula- 
tions in full analogy to the above and 
prove the following relation : 





0) a 
Fig. 84 


ie CO | Q(x,9) d, (3) 
2 z 


which is analogous to the relation (2) but differs from it in the sign 
of the right-hand side. This difference which may at first appear 
strange is due to the fact that in the choice of a definite direction to 
describe closed curves the mutual position of the coordinate axes 
loses its symmetry; by describing a circle with centre at origin of 
coordinates in the direct way (fig. 85), we must in transit from the 
positive direction of the OX-axis to the positive direction of the 
OY-axis describe an arc of 90° whereas the reverse description 
involves an arc of 270° (or an arc of 90° in the opposite direction). 
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Let us now assume that the shape of the region Dis, as shown in fig. 83 
and fig. 84 (this condition is satisfied by every circle, ellipse, rectangle 
and more general figures of the type shown in fig. 86). If P (x,y), 
Q (x, y) are continuous functions with continuous partial derivatives 
inside and on the boundary of the region D, then both relations (2) 
and (3) hold. 





Subtracting (2) from (3) we obtain : 


| | oes = s dx dy =| (P dv + Qady). (4) 
D 


L 


This most important relation which connects a double integral 
with a curvilinear integral and has numerous applications is usually 
known as Green’s formula. We have proved 

this formula for regions of specific form. 

However, Green’s formula can be readily 

extended to a much wider class of regions. In 

fact, let us consider a region D bounded by a 

simple (smooth, i¢. not intersecting itself) 

contour (Fig. 87) and draw a smooth curve 

i to divide this region into tworegions D, and 

D,.. Assuming that Green’s formula holds in 

both regions D, and D,, we can write it for 

: these regions and add the two formulae term- 
Mer ei by-term. We then obtain on the left-hand 


side the double integral 
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while on thc right-hand side we have a sum of two curvilinear 
integrals taken along the contours of the regions Di and D, 
respectively in the direct way. The arrows 
in fig. 87 show that these integrals describe 
the curve / in opposite directions as a result 
of which their corresponding parts cancel 
each other; the remaining parts of the 
integrals evidently give one integral taken 
along the contour L of the region D in the 
direct way ; we thus see that if Green’s 
: formula holds in the regions D, and D,, 
Fig. 88 it also holds in the region D. By repeating 
this argument we readily find that this 
result remains valid if the drawn lines divide the region D into an 
arbitrary number of regions, provided Green’s formula holds in each 
region. Hence this formula holds not only in regions of specific 
form for which we have proved it above but also in every other 
region which can be divided into a finite number of regions of this 
kind by means of corresponding curves And as can readily be seen, 
this gives a very wide class of plane regions. Green’s formula also 
holds in the so-called ‘‘multiply-connected” regions with “holes” 
(fig. 88), z.e. in regions which are bounded not by a single curve but 
by several closed curves, provided this region is the sum of regions of 
the simple type considered above. The curvilinear integral on the 
right-hand side of Green’s formula then represents the sum of 
integrals round the outer contour of the region D and the contours 
of all the “holes’’, where each contour is described in the direct way, 
t.e. such that the region D always remains to the left of the direction 
in which the contour is described. 





Finally it can be shown that Green’s formula also holds in 
every region bounded by a smooth closed curve. For this purpose 
we must begin by proving that the region bounded by a polygon 
(broken contour) is always equal to the sum of regions of the type 
considered above so that Green’s formula can be applied to every 
polygon. After this we inscribe in the given polygon another 
polygon with very small sides and apply Green’s formula to it; 
assuming that the sides of this polygon become infinitely small we 
can show by a limiting process that the relation expressed by Green’s 
formula also remains valid for the given region bounded by asmooth 
contour. We cannot give details of this proof here. 
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For exercises to § 123, cf Problem Book by B.P. Demidovich, 
‘Section VIII, Nos. 341, 342. 


$124. Application to differentials of functions of 
two variables 


Apart from being theoretically important Green’s formula finds 
many applications in problems of physics and mathematical analysis. 
‘One of the most important applications of this kind is considered in 
this paragraph. 


Let P (x, y) and Q (x, y) again denote two continuous functions 
with continuous partial derivatives in a region D in the xy-plane. - 
For the sake of simplicity we shall assume in all that follows that the 
region D and all other regions which we shall meet inthis paragraph 

. are open (i.e. consist of interior points only) that they are connected 
(i.e. they have no “‘holes’?) and bounded by simple (non-intersecting) 
. smooth contours. 


We know (§ 90) that if the expression 
P (x, y) dx + Q (8,9) & (1) 
is differential of a function F' (x,y) in a region D, then in this region 


5 y 

Pasy= &, = (2) 
- conversely, as a result of the assumed continuity of the functions P 
and Q, it follows from the relations (2) that the function F (x, y) has 
a differential in the region D which is expressed by formula (1). It 
is obvious that for some analytical problems it is essential to have a 
criterion in order to determine whether the expression (1) will be 
. differential of a function of two variables in the given region. We 
shall see that Green’s formula enables us to establish the necessary 
and sufficient condition for this purpose which must be satisfied by 
the functions P and Q ; in fact, we shall deduce not one but three 
-such necessary and sufficient conditions (which are, of course, equi- 
‘valent but expressed in different terms). 


Theorem. For each of the following four statements : 


1° the expression P dx+-Q dy is a differential of a function F (x, y) 
.in the region D: 


2° we have OP | 0» = 0Q/ Ox everywhere in region D; 
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3° the curvilinear integral 


[ ear + Qu, 


round any smooth closed curve which lies entirely within the region D is equal’ 
to zero; 


4° the curvilinear integral 


[ Part OH) 
AB 


only depends on the points A and B in the region D and not on the path: 
Joining these points along which it is taken, provided this path is a smooth 
curve and lies entirely within the region D; 


— the other three are corollaries. 


This theorem also shows that any of the three conditions 2°, 3° 
and 4° can be the necessary and sufficient condition for the expres- 
sion P dx + Qdy to be a differential of the function F (x, y) in the- 
region D; we shall also see that the proof of this theorem will enable 
us to find an expression for the function F (x,y) in all cases when it 
exists. 


In erder to prove this theorem we shall begin by establishing - 
four auxiliary propositions whose set will be equivalent to this- 
theorem. 


Lemma 1. 2° follows from 1°. 


Proof. It follows from P dv + Q dy = dF that 


oF oF 
P=, ——- 
Ox” oy” 
therefore 
cP. C0 Oe 
oy = Ox Oy’ ax Op Ga’ 


since the functions dP / @y and 9Q_/ dx are continuous, therefore the- 
righthand sides of these equations are equal to one another; hence- 
the left-hand sides are also equal and lemma 1] is proved. 


Lemma 2. 3° follows from 2°. 


Proof. Let ZL be a closed smooth curve which lies entirely 
within the region D. Let us apply Green’s formula to the region: 
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A bounded by the curve Z. Since, according to our assumption, we 
have @P / dy = 0Q/ 6x everywhere in the region D, therefore the 
left-hand side of Green’s formula vanishes and we have: 


[ Part Qa) = 0, 
L 


which was to be proved. 
Lemma 3. 4° follows from 3°. 


Proof. Let us join the points A and B in the region D by two 
arbitrary smooth curves £, and Ly, which lie entirely within the 
region D and do not intersect one another (fig. 89). In that case the 
curve L£, from A to B and the curve L, from B to A together form a 
closed curve; hence as a result of our assumptions we have 


(Ly) (Z) 
| (P dx + Ody) + | (Pick Oy Se: 
AB BA 
and since 
(L.) (L) 
[ ea + ou) =—-| Pa + OH), 
BA AB 
therefore 


(Ly) (Lq) 
[ea+amn= | Patou); 
AB AB 


this proves lemma 3 for non-intersecting curves. However, if the 
curves £, and JL, intersect one another (fig. 90), we must join the 


yA 
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‘points A and B by a third curve L, which also lies in the the region 
.D and does not intersect the curve J, or the curve Z, *). It then 
‘follows from our proof that the integral along the curve LZ, will 
-coincide with the integral along the curve Z, and the integral along 
the curve Z,; hence these two integrals must coincide with one an- 
-other and lemma 3 is proved. 


Lemma 4. 1° follows from 4°. 


Proof. Let us consider a fixed point A (%9,_%) and a variable 
“point B (x, y) in the region D, where the point B can move anywhere 
in the region D. Since we are assuming that the integral 


[ (Pat au) 
AB 


‘is independent of the curve joining the points A and B along which 
‘it is taken (provided this curve is smooth and lies entirely within the 
region D), therefore, as the position of the point A is fixed, this inte- 
‘gral only depends on the position of the point B, z.e. it is a single- 
valued function F (x, y) of its coordinates. We will show that at 
every point of the region 


oa 


-and hence, as a result of continuity of the functions P and Q 


dF = Pdx + Q ay, 


‘ 


‘which proves lemma 4. 


Let us prove, for example, the relation dF / dx = P. Let 
.B (x,y) be an arbitrary (interior) point in the region D3; if | 2 | is 





yA 
B C 
A 
4 
=O 
0; x 
Fig. 91 Fig. 92 








*) We are assuming here, for the sake of brevity, that this curve Ls; exists. 
However, this is not always so as can be seen from the case depicted in fig. 91. 
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sufficiently small, then the point C (x + A, y) also lies in the region 
D. Let us join the points A and B by an arbitrary smooth curve- 
which lies entirely within the region D; continuing this curve to the: 
point C with the help of the straight line BC we evidently obtain the: 
(smooth) curve ABC which joins the points 4 and C and lies entirely~ 
within the region D (fig. 92). We therefore have: 


F (x,9) = | (Pax + Q4), 
AB 


F(s+ hy) = | Pax + Q6) = 
ABC 


=| Pax + Qu + [Pax + aH, 


AB BC 
hence 
F(x +h) — F@2)= | (Pav + Qa) = | Pas, 
BC BC 
since *) 
[ Qa =0. 


But it follows from the mean-value theorem that 


| Pdx =h P(E, y), 
BC 


where x << & <x +h. We therefore obtain: 


* Par F ’ bea 
F(x + AD EG Se 





and since we have &-» « ash — 0 and the function P is continuous: 
at the point B (x, »), therefore 


oF , 
ag PO); 


—— ; 

*) Since the curve BC is horizontal ; this can be shown formally in the same 
way as in the deduction of Green's formula where the curvilinear integral with res- 
pect to x along a vertical section was shown to be equal to zero. 
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the following relation is proved similarly 
oF ; 
oy =a Q Gs D)s 


which concludes the proof of lemma 4. 


The lemmas | — 4 are evidently equivalent to the fundamental 
theorem formulated above, and its proof is thus also concluded. 


_ For exercises to § 124, cf. Problem Book by B. P. Demidovich, 
Section VIII, Nos. 300, 302, 305, 308. 


§ 125. Curvilinear integrals in space 


The concept of curvilinear integrals can be extended without 
‘difficulties to cases when integration is carried out along curves in 
space. In the simplest case when the given section AB of a curve in 
‘space can be expressed by equations of the form . 

9 =9(s),2=4(x) (@<x<banda>x>d), 


where the functions 9 (x} and ¥ (x) are continuous in the interval 
(a, 6), we assume, in accordance with the definition, that 


b 
[F (x,y, 2) dx = | Pix, 9 (x),  (a)] dx; 
AB e 


this implies that as in the case of plane curves 


[F (0,9, 2)dx=— | eee 
BA AB 


This initial definition only applies to intervals of very simple 
form but it can be extended in the same way as in plane curves. 


Assuming that the functions 9 (x) and \ (x) have continuous 
derivatives in the interval .(a, 6) we again divide the arc AB into 
“cells” A; which are now small arcs of a curve in space. We have 
(§ 53): 

Xx 
Mem [VTE St TY Was, 


Xk-1 





where x;-; and x; are the abscissae of the ends of the cell A ,. 
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Let us denote by « = « (x, y, z) the angle between the tangent 
to the curve AB at the point (x,y, z)and the positive direction of the 
‘O X-axis (where the direction of the tangent is chosen in relation to 
the movement from A to B) ; we therefore have (§ 98) 

1 


cosa = + Sse ee ag 

V1 + 9” (%) + Y"? (x) 
where we have ‘ + ” in the interval A; provided x; > x ,-, and 
‘* — » in the opposite case. By repeating the arguments used in 
§ 121 word by word for plane curves we readily arrive at the con- 
clusion that in the case of a simple interval AB the following formula 
holds : 





[F (4¢.95:2) dx = | F (x,y, 2) cos @ (x, y, z) da, 
AB AB 


which is analogous to formula (6) § 121. Here, as before, the inte- 
gra] on the right-hand side is defined constructively (as the limit of a 
sum of definite form) and also holds along an interval of more com- 
plicated form than that of the interval AB (thus it always holds when 
these intervals can be divided into a finite number of simple subinter- 
vals ; this embraces the simple closed curves ; the integral evidently 
also has a sense in the more general case when AB is an arbitrary 
smooth curve as we have shown in § 121 for plane curves). Hence 
‘we can in this case also regard the formula obtained as definition of 
the space integral on its left-hand side. In simple cases this defini- 
tion always coincides with the earlier definition. 


It is clear that all we have said above refers to integration with 
respect to the variables y and z. If P, Qand R are three continuous 
functions of x, y and z in a region in space which contains the curve 
L = AB within itself, then similar to formula (8) § 121 we have : 


[ eas + Qdy + Raz) = | (P cos% + Qcos® + Roos Y) da, 
L L 


where a, 8 and Y are the angles between the tangent to the curve L 
at the point (x, y, z) and the positive direction of the axes of coordi- 
nates ; the direction of the tangent must be taken in relation to the 
chosen direction of movement along the curve L. 


Owing to the fact that physical processes connected with the 
existence of fields of force usually take place not in a plane but in 
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three dimensional space, therefore, it is clear why it is desirable to- 
calculate the work performed by the forces of the field in displacing 
a point along any smooth curve in space (assuming, of course, that 
the field itself acts in space or in a part of it). If the vector of the 
field at the point (x, vy, z) of the three-dimensional space is given in 
terms of its components P (x, 7, z), Q (x, 9, z), R (x,y, Z),wecan show 
in the same way as in § 122 where we have dealt with plane fields,. 
that the work IV done by the field in displacing a point along the- 
curve AB is expressed by the curvilinear integral 


[ Pax + Qay + Raz. 
AB 


Finally as in the plane case, curvilinear integrals along curves in. 
space are important in deciding whether the expression 


P (x, 9, z) dx + Q (x, y, 2) dy + R (x, 9, 2) dz 


is differential of a function F (x, y, z) of three variables. For regions. 
in space, whose form is sufficiently simple, a proposition holds comp- 
letely analogous to the theorem in § 124, and involving equivalence: 
of the following four propositions : 


1°’ The expression Pdx + Q dy + Redz ts differential of a function: 
F (x, », Z) in the région V ; 


2°" the following equatit ..» hold everywhere in the — V 


gP_30Q @aP_@R 4Q_ ; 
oy Oe ° Ge Bx * Fz on 


3°’ the curvilinear integral 





[ @ax+ dy + Rdz) 


taken along any smooth closed curve sa lies entirely within the region V is: 
equal to zero ; 


4°" the curvilinear integral 


[ @axt Qa +Ran 
AB 


depends only on the points A and B and not on the curve connecting these points: 
along which it 1s taken, previded this curve is smooth and lies entirely within: 
the region V. 
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In order to prove this equivalence we must prove four lemmas 
which are completely analogous to the lemmas 1—4 § 124. The 
formulation of these lemmas is quite clear and we shall not give them 
here. The reader will have no difficulty in showing that proposi- 
tions analogous to the lemmas I, 3 and 4, § 124 are proved inexactly 
the same way as before ; however, the position is somewhat different 
with the proposition analogous to lemma 2: at present we cannot 
prove that 3°’ follows from 2°’ as this is done for lemma 2 § 124, 
since we have no formula for curvilinear integrals in space analogous 
to Green’s formula for plane integrals. We cannot deduce sucha 
formula in this chapter since a new concept of surface integrals is in- 
volved which we shall introduce in the nextchapter. Weshallreturn 
to this problem later and on the basis of a formula, similar to Green’s 
formula, which applies to curvilinear integrals in space, we shall 
conclude the proof of equivalence ofthe statements 1°’— 4°’ by proving 
the remaining link in the chain of our lemmas (‘3° follows from 2°”) 
which we are unable to do here. 


For exercises to § 125 ¢f. Problem Book by B.P. Demidovich, 
Section VIII, Nos. 326, 328, 335. 


CHAPTER XXIX 
SURFACE INTEGRALS 


§ 126. The simplest case 


In § 121 we have defined a curvilinear integral by developing 
the concept of an integral depending on a parameter (or, in the case 
of integrals in space, on two parameters). If we begin with adouble 
‘integral depending on a parameter, a similar development will lead 
us directly to the important concept of surface integrals to which 
this chapter is devoted. 


Let us consider a surface ofx‘and y in a region D (we can at 
present assume that this region D is any arbitrary measurable figure) 
which is expressed by the equation 


Zz =f (x, D)s (1) 
where the function f(x,y) is continuous in the region D. Let us 
denote by S a part ofthe surface (1) projected onto the region D by 
means of straight lines parallel to the O Z-axis. Let F (x, y, z) bea 
continuous function in a given region of the three-dimensional space 
containing the whole part S of the surface (1). If we assume that the 
number z is constant, the double integral 


[J Foo, Zz) dx dy 
“ D 


will contain z as a parameter and evidently be a function of this 
parameter. However, we can adopt a more general point of view 
and assume that z is an arbitrary function of x and y and is conti- 
nnous in the region D ; let this function be, say, the function f (x, ); 
im that case the given integral takes the form 


|| Flsxs Giri de dy, 
, | 
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where the integrand is continuous in the region D so that there is no 
doubt as to the existence of the integral. Such an integral is called 
a surface integral of the function F (x, y, z) on the part S of the surface 
(1) and denoted by 


{{ F (x,y, z) dx dy; 
s 


the index S on the integral indicates that z must be regarded as a 
function of the variables x and y during integration and defined by 
the equation (1) of the surface, of which S is a part. Thus if z is 
constant in the region D (the initial part in our development), this 
implies that the surface (1), over a part of which we integrate, is a 
plane parallel to the YOY-plane and the surface integral becomes the 
usual double integral. 


Let us now assume that the function f(x, y) is continuous in 
the region D and has continuous partial derivatives in this region. 
Let us divide the part S of the given surface into smaller parts 
(“‘cells’?) with small diameters*). The area o, of the cell with the 
‘same index can be expressed by the following integral as shown in 
§ 120: 

-: ae Ice % || V1t FEC IFS I) de dy 


cos a 





where Ax fre the ae of the cell o, onto the YOY-plane 
and Y is the acute angle between the normal to the given surface at 
the point [x, », f(x, »)] and the positive direction of the OZ-axis. 
In accordance with the mean-value theorem (§ 116) we have: 


where Y, is the value of the angle Y at the point (x,;, y;, Z,) of the 
cell o,. 


Let us now construct the sum 


‘} F (xz, Dus Zp) COS Vy» Cy = MF les Ds SI Bis Jed] Ax 
k E 


*) So as not to complicate our arguments with details which have no direct 
connection with the subject uncer consideration, we shall always assume in future 
that these cells, and all other reg:ons which we shall encounter, are connected figures 
bounded by relatively simple coriiours so that we can apply the concepts and results 
obtained above to all of them. 
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including all cells on the part S; since, according to our assumptions, 
F(x, y, f(x, y)] is a continuous function of x and » in the region D, 
therefore the right-hand side of this equation, in accordance with the 
result of chapter 27, will tend to the following double integral as its 
limit when the above division becomes indefinitely fine: 


[[ Fl» Fe mide, 
D 


which is no other than the surface integral defined above 


| | F(x, 9, 2) dx dp. 
S 


This surface integral can therefore be regarded as limit of the sum 


-2 F (xg, Diy Zc) 
vee a (Xs De) +S vy? (Kes Ix) 





Ox 





> ae tee Drs Zn) cos Yue F * 
k 


when the division becomes indefinitely fine. But limit of the sums of 
- the form 


» ? (Xu Jk Zn) Gr, 
k 


where o,, are areas of the cells into which the part S is divided and 
(Xp Jey Zp) 18 an arbitrary point in the cell o,, as considered in § 120, 
example 2, where we have agreed to call this limit as integral of the 
function °(x, 9, z) over the part S' of the given surface and denote it 
by 


ff o (x, 9, Zz) do. 
5 


We therefore have in our case: 


{| F(x, y, z)dx dy = {{ F(x, y, z) cos Y (x, y, z) do = 
S S 


Ny Dy ai do (2) 


Tie + (Ly 
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This formula is analogous to formula (6) § 121 and plays the 
same role for surface integrals as formula (6) $121 plays in the theory 
of curvilinear integrals. Even in the simplest case which we are now 
considering it defines a surface integral constructively (since the 
right-hand side of formula (2) is obtained as the result of a construction 
and defined as limit of a sum of definite form). Further, as we shall 
soon see, formula (2), like formula (6) § 121, serves as the basis for an 
extension of the concept of surface integrals beyond the limits of the 
simplest case which we are considering in this paragraph. 

It is self-evident.that similar definitions and relations hold 
if we integrate with respect to the pair of variables (x, z) or (), 2), 
provided the chosen part of the surface can be expressed by equations 
analogous to the equation (1). In practice one frequently meets sums 
of three integrals taken over the same part S which involve different 
pairs of variables. 

Let P(x, y, z), Q{x, », z), R(x, y, z) be three continuous func- 
tions in a given region ina three-dimensional space which contains the 
part S within itself. Let « = « (x, y, z), B=B(x, 9, 2), Y=Y (xy, 2) 
be the angles between the normal to the given surface at the point 
(x, », Z) on the part S and the positive direction of the OX, OY and 
OZ axes respectively and let the direction of this normal be so chosen 
that the angles #, 8 and Y are acute on the part S. It is customary 
to write the sum of the integrals , 


[[P@nobe+ [[ Qs 2,2 dede + 
; s 
+|| R (x, 9, 2) de dy 
Ss 


in the form of one integral 


{f (P dy dz + Qdz dx + Rdx dy); 

S 
if the chosen part S is such that each of the three coordinates on this 
part is a single-valued function of the other two and has continuous 
partial derivatives so that on the basis of the above discusston we 
evidently have : 


{| P dy dz= J P cos adc, [[ oe a= fj Q. cos 2 do, 
Ss 


S S S 


[[ Rava =[[ R cosy as, 
¢ 


s 
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and consequently 


ff (P dy dz + Qdz dv + Radx dy) = 
§ 


os [ (cosa + Qos B + R cos 7) do. 
AY 


§ 127. General definition of surface integrals 


We have found at the beginning of § 126 that the simple 
definition of the surface integral 


F(x, y, z) dx dy (1) 
{| 
S 


essentially implies that the given surface can be represented over the 
part S by an expression of the form (1) § 126, i.e. every straight line 
parallel to the OZ-axis intersects the part S in no more than one 
point. ‘This condition is very restrictive in practice where we often 
integrate round closed surfaces which do not satisfy the above con- 
dition. We'must therefore develop the concept of a surface integral 
beyond that considered in § 126 so that it covers more complicated 
cases occurring in practice. 


A useful starting point for this development is given by formula 
(2) § 126. The middle part of this formula is, by definition, inde- 
pendent of any specific shape of the part S and remains fully valid, . 
for example, for relatively simple closed surfaces. Although in the 
simplest case the relation (2) § 126 is proved as a theorem, we can 
nevertheless regard the first equation of formula (2) § 126 as the 
definition of the integral standing on its left-hand side. We are thus 
able to define the integral (1) for every part S on which the integral 
in the middle part of formula (2) § 126 exists. This gives us a much 
wider scope guite sufficient for many cases. 


However, in order that this definition should be unique it is 
necessary even for surfaces of a more general form to indicate exactly 
the value of the angle ¥(x, », z) in the middle part of formula (2) 
§ 126; assuming that Y always denotes the angle between the normal 
to the given surface and the direction of the O-axis, we must 
establish a definite directzon for the normal at every point on the given 
surface (which is, of course, equivalent to the choice of the sign of 
cos Y). Inthe simplest case we have agreed always to direct the 
normal in the positive direction of the OZ axis, i.e. to make the angle 
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Y acute (cos Y > 0). This agreement appeared natural at that time 
(in fact, it is the only possible one), since cos Y has first appeared in 
our arguments as the ratio of two areas. However, it can be readily 
seen that for figures of more general form this ratio would be 


inconvenient. 


Let us imagine, for example, that S' is the surface of a sphere. 
Then on the upper hemisphere we must take exterior points and for 
the lower hemisphere interior points on the sphere for the given 
direction of the normal; by passing through the equator the chosen 
direction would suddenly be reversed (fig. 93). It can be readily 
seen that a definition connected with this choice of direction of the 
normal will in most cases contradict the essence of the problem and 
unnecessarily complicate its solution. We shall therefore now intro- 
duce a new idea for the direction of the normal which is free from 
this disadvantage. 


In order to make this new definition more concrete let us first 
return to the case when S is the surface ofasphere. It is immediately 
clear and also confirmed historically that in many 
practical cases connected with integrals of the form 
(2) § 126, it would be most convenient to direct the 
normal to every point either on the exterior or the 
interior of the sphere, ?.e. to deal everywhere with an 
outward or inward normal. Let us select, say, the 
outward normal, 1.e. let us agree that Y in the integ- . 
ral (2) § 126 denotes the angle between the outward 
normal to the sphere S at the point (x, y, z) and 
the positive direction of the OZ-axis. In that case Fig. 93 
Y will be acute for points on the upper hemisphere $,, be a right 
angle for points on the equator and an obtuse angle for points on the 


lower hemisphere S,. Therefore if IJ F dx dy and IJ F dx dy res- 








pectively denote surface integrals over ihe’ ‘simple” a S, and S» 
defined in the sense given in § 126, then, in accordance with our new 


definition of the angle Y, we have 


[ [ #05 Ydo - | Fdx dy, 


cet Sy 


[J Fe0s Jde= — [[ rare, 


Sg Se 
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so that it follows from the extended definition of the surface integral 
(formula (2) § 126) that 


Fdxdy = Fcos Ydo = Fcos Ydo + cos ¥do = 
Aeon || IJ IJ 
aera] ae (2) 


(where we must note that both integrals on the right-hand side are 
defined in the initial sense given in § 126). Our definition of the 
angle ¥ is such that the normal at every point on the sphere is directed 
outward so that cos Y > 0 for points on the upper hemisphere and 
cos Y < 0 for point on the lower hemisphere. In accordance with 
this definition we say about the integral (2) that it extends over the 
exterior of the sphere S. We could, of course, agree to take the inward 
normal instead of the outward normal at all points on the sphere S; 
since cos Y changes its sign in the transition from the outward to the 
inward normal at every point of the surface S, therefore our two 
integrals will only differ from one another by their sign. 


The position is even simpler when the part S has the shape 
considered in § 126, i.e. when it can be expressed by an equation of 
the form (1) § 126. We have selected the normal directed upwards 
(cos Y > 0) and proved that 


[[ Fae = il F cosy de. 
S S 


In accordance with our new point of view we can therefore say that 
this last integral extends over the upper pari of S. On the other hand, 
if we agree to direct the normal downwards, then the integral 


{| F cosy de (3) 
S 


will reverse its sign ; this will be an integral extending over the lower 
part of S. We thus see that the notation (3) does not tell us anything 
about the direction of the surface S over which we integrate; it must 
be stressed separately in every case. 


Let us now consider the general case. Will S be a closed 
surface (like a sphere) or have a definite contour (boundary) ? We 
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have seen in the last two examples that we can usually distinguish 
between two “sides” of this surface. If we are given a definite side 
of a surface, we are simultaneously also given a definite direction for 
the normal. 


If a given side of the surface is chosen, then the surface integral 


{| Fdx dy, 


S 


extending over this side of the surface is, by definition, equal to the 


integral 
il Fcosy ds, 
RY 


where Y is the angle between the chosen direction of the normal 
and the positive direction of the OZ-axis. 


However, if we want our definition to cover the widest possible 
class of surfaces, we must consider in somewhat greater detail what is 
meant by the two “sides” of a surface mentioned above; even in 
elementary cases this problem may cause some difficulties. 


Let us assume that the surface S in which we are interested 
(or part of this surface) has a tangential plane at every point whose 
direction changes continuously in relation to the continuous dis- 
placement of the point over the surface. We have said above that 
in order to choose a definite side of our surface it is sufficient to 
cheose a definite direction for the normal at every point. However, 
if we choose this direction at different points of the surface S inde- 
pendent of each other, then, in general, we shall obtain nothing 
useful, for in this case the angle Y may everywhere be a disconti- 
nuous function of the position of the point so that integrals containing 
cos Y will be devoid cf meaning. ‘These formal considerations as 
well as visual representation clearly show that we can only choose 
the normal at every point on the surface so that its direction changes 
continuously as the point moves continuously over the surface ; in 
other words, it is imperative that the angle Y should be a continuous 
function of the coordinates of the point to which it refers. 


Let us now take an arbitrary point A on the surface S and 
draw a normal to the surface at this point and choose one of the two 
possible directions along this normal. We shall displace the point 
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A continuously over the surface and at every point through which 
we are passing we shall ascribe that possible direction to the nor- 
mal to the given surface which leads us to it by following a conti- 
nuous path. Let us assume that having covered some distance in 
this way we return to the point A. What will be the direction of 
the normal at this point on arrival — will it be the same as the initial 
direction or will it be the reverse? It can be readily seen that, as 
in the two examples considered above as well as in many other 
examples which we might think of, we shall always return to the 
point 4 so that the normal has the same direction as that with which 
we began (it is assumed that our path does not intersect at the edge 
of the surface S). However, this rule does not apply to all surfaces ; 
let us consider, for example, the well-known “Moebius ribbon’’, 
whose model can be obtained by cutting in paper the rectangle 
abed (fig. 94) and, after turning it, glueing the side ad to the side bc 
so that a coincides with ¢ and d with b. It can be readily shown. 
that having selected an arbitrary point A on this ribbon and having 
described the whole ribbon as explained above we shall on our 
return to A have reversed the direction of the normal. In future 
we shall almost entirely disregard such surfaces (which are exceed- 
ingly rare in practice) and assume that irrespective of the chosen 
starting point and the continuous path over the surface by which 
we may travel as long as it does not intersect the edge of the surface, 
the normal on our return to the starting point will have the same 
direction, provided it has changed continuously in our movement 
over the surface. 


This shows that it is sufficient to choose the direction of the 
normal at any given point A on the surface S for it to remain 
defined uniquely at every other point on 

d ¢ this surface. In fact, if B is another arbi- 
trary point on the surface, then two arbi- 

fs trary path Z, and L, from the point A to 
2 > the point 8 will give us the same direction 
Fig. 94 for the normal at the point B, for otherwise 

by starting from the point B and following 

the path Z, in the opposite direction (to the point A) and then the 
path L, in the straight direction we should end at the point B with 
a normal whose direction would be opposite to that with which we 
started; and this, in accordance with our assumption, is impossible. 


Hence for surfaces of the, type considered above the choice of 
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direction of the normal at one point on the surface defines uniquely 
its direction at all other points on this surface, z.e. it defines uniquely 
the side of the surface; by choosing the opposite direction for the 
normal at the given point we simultaneously change its direction at 
all other points of the given surface and thus change to the other 
side of this surface. Hence surfaces of this type are known as two-sided 
(in contrast to one-sided, an example of which is the Moebius ribbon). 


After these explanations we can return to the definition of an 
integral taken over the given side of the surface. Let D be a twoe 
sided surface (or a part of such a surface) where we have chosen one 
side. Let ¥ = Y (x, y, Z) be the angle between the positive direction 
of the O%-axis and that direction of the normal to the surface S at 
the point (x, », z) which defines the side of the surface chosen by us; 
in accordance with our definition we can then assume that 


{| F dx dy == {{ F cos ¥ do, 
$ 


¢ . 
». 


where we assume that the integral on the right-hand side exists and 
is defined as limit of sums of definite form similar to those described 
in § 126. This notation tells us nothing about the side chosen on the 
surface S and this fact must therefore be stressed separately in each 
case. If the surface S' is closed, it is usual (and we shall do so in 
future) to consider that the above integral applies to the exterior of 
this surface so that Y is the angle between the outward normal to the 
surface S and the positive direction of the OZ-axis. 


It is interesting to compare this wider definition of a surface 
integral with the initial definition for the simplest case given in § 126. 
Let the surface S (as is usual in many real cases) be divided into a 
finite number of “‘simple”’ parts 51, 53,..., Sp, etc. each of which can 
be expressed by an equation of the type (1) § 126. In accordance 
with our wider definition the integral taken over the given side of 
the surface S is equal to the sum of the integrals taken over the same 
side of its component parts so that evidently 


n 


{{ Feosy do = ¥) [| Foose. 


S i=] s 


However, on every part S; the integral taken over the chosen side of 
the surface coincides with the integral defined in § 126, provided 
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cos Y > 0, i.e. provided the chosen side of the surface S' is the upper 
side ; otherwise the absolute value of these two integrals would be the 
same but their signs opposite. Hence the integral taken over the 
given side of the surface is equal to the algebraic sum of the integrals 
of its component simple parts if these integrals are defined as in 
§ 126; in this case integrals taken over upper sides of the surface $ 
have the sign ‘‘ + ” and those taken over inner sides have the sign 


“e 33 
_ . 


Finally all that was said above in connection with integrals of 
the variables (x, y) evidently remains valid for integrals of the pairs 
(z, x) and (», z). For integrals taken over a definite side of a two- 
sided surface S we obtain the following general formula: 


ff (P dy dz + Qdzdx + Rdxdy) = 
S 


= | (Pcose + QcosB + R cosY)ds, (4) 
S 


where P, Q, R are continuous functions of x, y, z in a region in space 
which contains the surface § within itself and a, 68, and Y are the 
respective angles between the positive direction of the O.Y, OY, and 
OX axes and that direction of the normal to the surface S at the point 
(x, _, Z) which defines the chosen side of this surface, 


In the remaining part of this chapter we shall assume that all 
surface integrals apply over a definite side of the given surface in 
accordance with the established definition. 


Let us now make one final remark which is intended to clarify 
possible misunderstandings. In § 120 we have defined an integral 


J | 9 (x 9, 2) de is 


taken over a gwen part S of the surface. We have pointed out the analogy 
existing between this integral and the usual double integral taken 
over a part of a plane; in order to construct the integral (5) we must, 
as before, divide the part S into cells and multiply the area of each 
cell by a function 9 at an arbitrary point in the given cell; we then 

and limit of the sum of all these products. Hence the integral 
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(5) results from the well-known construction which is typical for all 
problems of integral calculus. 


In this paragraph we have defined the concept of a surface 
integral 


il F(x, 9, z) dx dy, (6) 
S 


taken over a definite side of the given surface S. What is the relationship 
between these two types of integrais ? This question can be clearly 
answered on the basis of the above arguments. The symbols (5) 
and (6) have a different meaning ; the integral (5) only depends on 
the part S and form of the function » but is quite independent of 
the choice of the ‘‘side” of this surface whereas the integral (6) 
changes its sign when the side chosen on the given surface is changed ; 
only after a definite side is chosen, the integral (6) has a definite 
meaning ; we can therefore say that the symbol (6) defines two 
separate integrals in relation to whether one or other side of the 
surface S is chosen. 


For exercises to § i127, cf. Problem Book by B.P. Demidovich, 
Section VIII, Nos. 403, 405. 


§ 128. Ostrogradskij’s formula 


In § 123 we have deduced Green’s formula which is very 
important in theory and practice; this formula connects a double 
integral taken over a plane region with a curvilinear integral taken 
over the contour of this region. A corresponding and no less 
important formula covering three-dimensional space was first 
deduced by M. V. Ostrogradskij; this formula connects a triple 
integraltaken over a region in three-dimensional space with a surface 
integral taken over the exterior of the boundary of this surface. 


Let us assume that we are given the region V in three-dimen- 
sional space bounded by a closed surface S. Let us assume at first 
that the shape of this surface is the simplest possible shape for a 
closed surface ; every straight line parallel to one of the axes of co- 
ordinates intersects it at no more than two points so that S is divided 
ino two parts — the “upper” and “lower” parts which can respec- 
tively be expressed by the equations z = fy (x, y) and z = fo» (*,9); 
we shall assume that the functions f,; and f/f, are continuous 
and have continuous partial derivatives with respect to x and y. 
Finally, let the function R (x, y, z) and its partial derivative 
dR/dz be defined and continuous in a region in space which 
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contains the region V within itself. Let us consider the triple 


integral 
{\I Oss dx dy dz. 
cz 
V 


According to formula (2) § 119 we can represent it in the form 


ae 
[}4 | Site t dvds, 
DD falxss) 


where D denotes the projection of the region V on to the XOY-plane. 
But : 


pe 
rr dz= R[x, 9, fi (yD) — Ria, fo (% 9) I 
S a(x, ¥) 


therefore we obtain 
oR 
Ge} d a 
[[[Se araee 
V 


=[[ te xflorler dy — [[ Roofer] ab. 
3 D 


Let us consider the first of these two integrals. It follows from 
the definition of a surface integral that the first integral is an integral 
of the function R (x, y, z) taken over the upperside S ; [z =f, (%, »)] 
of the surface S and hence also over the upper side of the surface S. 
Similarly the second integral on the right-hand side is an integral of 
the function R (x, y, z) taken over the upper side of the lower part 
S, [2 =f (x, 9)] of the surface S'; but we know that in this case the 
same integral with its sign reversed (and in our formula it happens 
to have the “‘ — ” sign) will be the integral of the function R taken 
over the lower side of the surface S, which again coincides with the 
exterior of the surface S$: We therefore obtain : 


{{{22 aide f{ Rdxdy + {| R dx dy, 
V ¥ Se 
where the first integral on the right-hand side is taken over the upper 
side of the surface S', and the second over the lower side of the 


surface $4; since in both cases we integrate over the exterior of the 
surface S, the sum of the integrals on the right-hand side can be 
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replaced by one integral taken over the exterior of the whole surface 
S and we obtain the simple relation 


i{{[= dx dy dz—|[ Raxdy = [[. Roos 7 de; (1) 
V Ss 3 


the second and third terms of these equations are integrals over 
the exterior of the surface S. We have deduced this relation for 
closed surfaces S which are intersected at no more than two points by 
any straight line parallel to the OZ-axis; it can, however, be shown 
that it also remains valid in much wider cases. At first we note that 
the relation (1) remains valid when the surface § consists not only 
of S$, and S, but also of the cylindrical part S* whose generating 
lines are parallel to the OZ-axis (fig. 95); in fact, at points of the 
part S* the normal to the surface evidently makes a right-angle with 
the OX-axis, cos Y = 0, and we have: 


[[eaxay = | [ R008 y de = 0, 
S*¥ S* 


so that as before 


[[ Raxay + [[ Raver = 
§ 


Sy 2 
=[[Raray+ [[ Raxdy+ [| Raxdy = [| Rass, 
Sy Sy Se $ 


and formula (1) therefore remains valid. 





Fig. 95 Fig. 96 
We can also show that if the region V can be divided 1 -1eans 
of a surface drawn within it into two parts Vy and V, to ‘a4 of 
which the relation (1) applies, then this relation also applic to the 
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whole of the region V. In fact, we have : 


Wee dy dz= [[[fgexavae + [[[toexarae a 
V2 


Vy 
=[f Raxdyt |[ Raxdy, 
S§ Ss 


where S; and S, respectively denote closed surfaces which are the: 
boundaries of the regions V; and V, and where each of the last two. 
integrals is taken over the exterior of the corresponding surface. But 
Sy is part of the surface S and the demarcating surface S (fig. 96) 
while S$, consists of the remaining part of the surface S and the same 
demarcating surface S$; hence the latter sum of integrals can be 
represented as the sum of integrals over the exterior of the surface 
S and two integrals over the demarcating surface S; of these two: 
integrals one is taken over the side of the surface S which is the: 
exterior for the surface S, whereas the other integral is taken over 
the side which is the exterior of the surface S; it is evident that 
these are two opposite sides of the surface S, as a result of which the- 
sum of the two integrals vanishes and we obtain: 


[ffoBerw ae ffreren 


which we wanted to nn 

With the help of this theorem we can considerably widen the 
applications of formula (1) since most regions in space which are 
met with in practical cases can be divided by demarcating surfaces. 
into regions of simple form for which formula (1) was initially 
deduced. 

It is evident that all that is said above also refers to cases when 
the pair of the variables (x, y) is replaced by the pair of variables 
(9, 2) or (Z, x). IfP = P (9,2), Q= Q(x,7,2),R=R (x 9, z) 
are continuous functions with continuous partial derivatives in a 
region in three-dimensional space which contains the region V 
bounded by the surface S within itself, then we obtain for a wide 
class of such oe : 


ice ao 8 + SN dxdyde = 
V 


= | (Pdyde + Qdzdx+Rdxdy), (2) 
s 
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where the integral on the right-hand side is taken on the exterior of 
the surface S. We can ee write this relation in the form 


aa - 
ING ae legs © =) Se 


oa (P cosa + Qcos B + R cos 7) da, (3) 


where «, 8 and respectively denote the angles between the outward 


normal to the surface S at the point (+, 7, %) and the OX, OY and 
OZ axes. 


Formula (2) (or formula (3)) is the above mentioned Oitro. 
gradskij’s formula *). It is very important in many branches of 
physics, for it is the basis of the field theory; we shall return to this 
problem later. We shall now use Ostrogradskij’s formula in order 
to prove a theorem which is important in connection with many 
problems of physics; this theorem is analogous to the corresponding 
proposition proved in § 124 by means of Green’s formula. 


Theorem. In order that the integral 


Jf cosa% + Qcos® + Rcos Y) do, 


taken over any **) closed surface S which lies zithin the region V should be 
equal to zero it is necessary and sufficient that the following relation should be 
satisfied at every interior of the sae V: 


ae 4 

a oe +3 2 0. ( ) 
Proof. The sufficiency be the condition (4) can be seen directly 

from formula (3). In order to prove its necessity let us assume that 


at an interior point A of the region V, for example, 


mt Gy Oe 
It follows from the assumed continuity of the partial derivatives that 
this inequality will also be satisfied inside and on the boundary of a 





*) This formula is sometimes also known as the Gauss formula or the Gauss- 
Ostrogradskij’s formula. 

**) We naturally have in mind a surface to which Ostrogradskij’s formula 
can be applied ; this theorem remains valid even when the class of surfaccs J is made 
much narrow, for example, when we are only considering spherical surfaces, 
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certain spherev with centre at A whichlies entirely within the region 
V; hence 
oP 0Q , oR 
ane pa peal ( d d. 0. 
(G+ Fe ) a de > 
v 


But formula (3) then shows that for the surface s of the sphere v 


[ | @ cose + Qcos8-+ Rceos Y) de > 0. 


s 
This fully proves our proposition. 


‘For exercises to § 128 cf. Problem Book by B. P. Demidovich, 
Section VIII, Nos. 415, 416, 423, 424. 


§ 129. Stoke’s formula 


Ostrogradskij’s formula introduced in the previous paragraph 
can be regarded as an analogue to Green’s formula in transition 
from a plane to the three-dimensiorial space. We shall now deduce 
another equally important formula which involves the direct generalisa- 
tion of Green’s formula when a plane figure is replaced by a part of a 
curved surface. This formula connects an integral taken over a definite 
side of a part S of the surface bounded by the closed contour ZL with 
a curvilinear integral in space taken over its contour, i.e. it solves 
the same problem for acurved surface as is solved by Green’s formula 
for a plane. 


Let us first assume that the part § of the given surface is ex- 
pressed by the equation z= f(x,y); we shall make the usual assump- 
tions as to continuity and differentiability with regard to the function 
f and the functions P, Q, R which we shall introduce below. Let 
us begin by considering the curvilinear integral in space 


| P (x,y, z) dx, (1) 
L 


taken round the contour Z of the part S and described in the direct 
way (i.e. so that to an observer moving over the upper side of the 
part S$ this part should always remain to the left of his path). Let 
the plane region s with contour denoted by/ represent the projection 
of the part S on to the XOY-plane; in that case the integral (1) can 
also be represented by a curvilinear integral in a plane 


le [xs 9» S (x, 9)} dx, (2) 
l 
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taken over the contour /; in fact, let /’ be a part of the contour / ex- 
pressed by the equation 


V=9(*)  (@Sx <b); 
where 2’ is the orthogonal projection on to the XOY-plane of a part L’ 
of the contour L which is evidently expressed by the equations 
y= (x), 2=f[x, 9 (x), 


and, in accordance with the initial definition of a curvilinear integral 
we have: 


| P (x, 9, 2) de = | Pix, 9 (ef le @ ())} de, 
L’ a 


b 
[2 borf eM de = [Piso WSs oI de: 
i a ; 


the right-hand sides, and therefore also the left-hand sides, coincide, 
which proves our proposition for simple sections /’ and L’.. Assuming 
that the contour LZ (and therefore also /) can be divided into a finite 
number of such simple sections we can directly see that in this case 


| P(x, y.2) dx = [ Pla GM] ds (3) 
L { 


this equation also holds in more general cases but we shall not stop 


here to prove it. , 


On the other hand, let us consider the integrals 


[Ae] are | 
§ S | 
J Vie dx dz = F ie cos B de, 


taken over the upper side of the surface S, where the angle Y and 8 
are defined as usual. It follows from the formulae of § 99 that 


of 
cos B = — res 








- + a/ (2) +(4)+ ae 
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where the sign of the denominator should be the same in both cases; 
since we have chosen the upper side of the surface S, therefore 


cos Y > O and the positive radical must be taken; regardless of this. 
we also have: 


cosh = — at cos Y, 
as a result of which the formula @) give: 
aP 4 oP afr. | 
ff 2 ax dy — 2 dv de) = NG ay Tag Gi ee 
s Shak 
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If we replacé.z by / (x, 7), the integrand in'this last integral will evi- 
dently be equal to 


BUS ree aC 


it therefore follows from the definition of a surface integral for the 
simplest case (§ 126) that this last integral can be written in the form 
of a double integral 


Na {P lx, yf (x, WV de dy, 


and we ob tain : 


ING OF gay ee. Jas —{ Pix, y, f (xey)}} dx dy. (5) 


Gsnsatie the formulae (3) and (5) we can see directly that, 
as a result of Green’s formula (§ 123), the right-hand sides only differ 
from one another by their sign. Hence the same also applies to the 
left-hand sides and we obtain:. i 


pP P 
| G dx dz ats dx dy) = | P (x, 9, Z) dx. (6) 
L 


Here the integral on the left-hand side is taken over the upper 
side of the surface S' and the integral on the right-hand side isin such 
a direction that an observer moving over the upper side of S should 
have the part S on his left. If we change the chosen side S and the 
direction in which wé describe. the contour L, then both sides of the 


SURFACE INTEGRALS 645 


equation (6) will change their sign so that this equation will remain 
valid ; it can be readily seen that in this case alsoan observer standing 
on the chosen (in this case lower) side of the surface and moving 
along the contour ZL in the new changed direction will have the part 
SS on his left. Hence this rule is of quite general character and defines 
uniquely the direction of movement over the contour L provided a 
definite direction is chosen for the surface § (and vice versa). 


Formula (6), like Green’s and Ostrogradskij’s formulae, possess- 
es the property that if the part S is divided by means of a line drawn 
onit into two parts $,and S,.toeach of which this formula applies, then 
this formula also remains valid for the whole parts S (the proof is 
‘exactly the same as for Green’s formula and we can leave it to the 
reader). With the help of this formula the validity of formula (6) 
(as for Green’s and Ostrogradskij’s formulae) can be established for 
a wide class of surfaces S. 


The circular transposition of the letters x, y, z on the one hand 
and P, Q, R on the other gives us two more formulae besides formula 


(6) : 
II (Goayde— FS a ydz ) =| 262.24, 


II (EF ae ay — 2 adn) Pa. (x, 9, Z) dz. 


Finally adding all three formulae we obtain the general Stoke’s formula 


iI ge aa it +(¥-2 dy de + (2 - os de axt = 


=| (Pdx +Qdy+Rdz), (7) 
2 


which we were trying to deduce. 


We have already said that this formula is a generalisation of 
Green’s formula :if S is a part ofthe YOY-plane, then Stoke’s formula 
becomes Green’s formula as can be readily seen ; hence the latter is 
a particular case of the former. 


Here we shall only gfve one of the numerous applications of 
Stoke’s formula. In § 125 we were unable to prove the following 
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lemma : if at every point of region V in a three-dimensional space the follow- 
ing equations hold : 


@P_3Q 9Q aR ak_aP (8) 
ay ox ’ Oz dy’ dx Oz’ 


then the curvilinear integral 





| (Pdx+ Qdy4+ Rdz), 
L 


taken along an arbitrary closed curve L which lies entirely within the region V 
1s equal to zero. The proof of this proposition follows directly from 
Stoke’s formula provided (which we must assume) that for every 
closed curve L in the region V a surface S exists which is bounded by 
the curve Z and to which Stoke’s formula applies (in most practical 
cases these conditions are satisfied)*). In fact, it follows from the 
condition (8) that on any closed curve ZL which lies entirely withir 
the region V the left-hand side, and therefore also the right-hand 


side, of Stoke’s formula is equal to zero which proves the above 
lemma. 


§$ 139. Elements of the field theory 


Mechanical and physical applications of the theory of curvi- 
linear and surface integrals have a common mathematical basis 
which is usually called the field theory. Some elements of this 
theory have already been considered in the last few chapters. 
However, in mechanics and physics a more visual terminology is 
usually preferred for quite understandable reasons in order to define 
the concepts and relations of the field theory; in practice these con- 
cepts and relations are usuaily formulated in the vector form; this 
makes them simpler and clearer and facilitates solution of the prob- 
lems. We shall therefore briefly consider the more important 
concepts and relations in vector form and thus make them more 
accessible**), 


I. Scalar aud vector fields. Quantities involved in mechanics: 
and physics can essentially be divided into two groups: scalars, i.e. 





*) We shall mention, however, a simple case when the required surface S does. 
not exist. Let the curve Z be a circle of unit radius and the region V a set of points. 
in space at distances more than 3} from the circle (the surface of such a region is. 
known as a “‘torus”). In this case there is evidently no surface which wholly 
belongs to the region V and which is bounded by the circle L. 


**) We assume that the reader is familiar with the clements of vector 
algebra. 


’ 
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quantities which are fully characterised by their numerical values 
(density, temperature, electrical potential) and vectors whose full 
characteristic involves direction as well as numerical value (velocity, 
acceleration, force). In physics other quantities are also used but 
their definition is even more complicated; however, we shall not 
consider them here. 


A component of a vector along an axis (a directed straight line) 
is, as we know, the projection of the vector onto this axis. We shall, 
in future, print vectors with bold-faced letters. The numerical value 
(non-negative) of the vector F is usually denoted by | F | andits com- 
ponents along the axes of coordinates by Fz, F, and F, respectively. 


If we have a scalar quantity F defined at every point in space 
or in a given part of it, then the set of these quantities F is known as 
the scalar field. The definition of a scalar field evidently does not 
differ in any way from the definition of a function F (x, y, z) of the 
coordinates of a point. We are given a vector field if at every point 
in space (or in a part of it) the vector F is defined (both in magni- 
tude and direction) ; in order to do this it is sufficient to determine 
the three components F,, Fy, Fz of the vector F at every point. 
Hence the definition of a vector field is equivalent to defining three 
functions Fy (x, y, z), Fy («, », Z) and F, (x, y, z) of the coordinates 
of the points in space. 


2. Level surfaces and gradient of a scalar field. Letusassume that 
we are given a scalar field F (x, y z) in space or in a part of it; we 
shall always assume that the function F has continuous partial deriva: 
tives of the first order in the given part of space. The equation 

ie (x, 9 2= ¢, 


where C is an arbitrary constant defines in general a surface which 
we shall call level surface of the given scalar field; it is quite clear 
that one and only one level surface of the given field can pass 
through every point in space so that two different level surfaces 
cannot have common points (they cannot intersect). 

We know (§91) that the rate of change of a function’ F (x, 9, 2) 
at the given point (x, y, z) in the given direction A is measured (in its 
absolute value and sign) by the derivative Da F of the function F in 
this direction ; this derivative (§ 91) is expressed by the formula 


PF 
- cos ¥, 
z 


where «, @ and Y denote the respective angles between the direction 
A and the positive direction of the OX, OY and OX axes. 
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Let us now consider the scalar field F (x,y,z) together with 
the vector field G (x, y, z) which is defined by the reiations 


oF oF oF 
= —, G = — 2 2 
Ca 4 Oy Oz 
so that 


Cx 
Ginn] = a/ (Cae Te fy + or FY! 


The vector G(x, y, z) is called gradient of the scalar field F(at the 
given point (x, y, z)) and denoted grad F. In accordance with the 
known laws of vector algebra the quantity 


D)F = G, cos « + G, cos 8 + G; cos Y 
is the projection of the vector Gin the direction A, i.e. 
DaF = |G| cos (G, A), 


where (G, A) denotes the angle between the direction of the gradient 
G and the given direction A. 





If we compare, the rate of change | Da F'| of the function F in 
different directions A at a given point (x,y, z), then the last equation 
shows that this rate will reach its maximum if | cos (G,A) | = 1 ie. if 
the direction A coincides with the direction of the gradient (or is 
opposite to it). Hence the direction of the gradient at every point gives 
the direction of the maximum rate of change of the given scalar field; this maxi- 
mum rate of change is expressed by 


oF? aly? oF\? 

io} = a/ (y+ 4) + &Y 
Let us finally note that since 0F / 0x, OF / 09, 0F / dz are 
proportional (§ 99) to the direction cosines of the normal to the 
surface F(x, », z) = Cat the point (x,y, Z), the direction of the gradient 
coincides with the direction of the normal to the level surface which passes 
through the given point. ‘The magnitude |G| =| grad F| of the 
gradient is measured by the absolute value of the derivative of the 
normal to the level surface; denoting this derivative by 0 F/dnwe have: 








an | 

3. Divergence of a vector field and flow across a given surface. Let 
us assume that we are given in space, or in a part of it, a vector 
field F (x, y, z). In practice the following quantity is very important: 


| grad F | -|< 


oF, , oFy , ah 
divF = ax + rites 2 
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which is known as divergence of the vector field F at the point (x, y, x). 
Divergence of the field at a given point is a scalar quantity and the 
set of its values in the part of space under consideration forms the 
scalar field. 


We shall now define a concept which is very important in 
practical applications of mechanics and physics, i.e. the concept of 
flow of a given vector field across the given surface. In order to make 
this coneept more accessible we shall illustrate it by a hydrodynamic 
model. Let us assume that the chosen part of space is filled with a 
moving fluid ; let us take a two-sided surface S in a region in space 
which is either open or bounded by a closed contour and choose on 
this surface a definite side in the sense defined in § 127. Let do be 
an element (a very small area) of the surface S. If at a given instance 
of time the rate of flow at a point on the element do is expressed by 
the vetor F, then the quantity of fluid which flows across this element 
in a short time interval df in the direction of the chosen side of the 
surface will evidently be equal (with an accuracy to infinitely small 
quantities of highers orders) to the quantity of fluid contained in a 
cylinder with a base do and the height | F | dt, whose generating lines 
-are straight lines parallel to the vector F. The volume of this 
cylinder is evidently equal to | F,! dido, where F,, is the projection of 
the vector F in the direction of the normal to the surface do corres- 
ponding to the chosen side of the surface. Hence the quantity of 
fluid which flows across the element do during the time interval dt 
-can be written in the form 
of, dt ds, 
where 9 is density of the fluid and mass of the flowing fluid can be 
positive or negative according as the fluid flows in the chosen direc- 
tion (F, > 0) or in the opposite direction (Ff, < 0). The mass of 
fluid which flows across the area do in unit time is therefore equal to : 


oF, do, 
and the mass of fluid which flows in unit time across the surface S$ 
-can be expressed by the surface integral 


AM = [f oF, do. 
S 


If we denote by «, 8, ¥ the angles between the chosen direction 
of the normal to the surface S and the positive direction of the axes 
of coordinates, then, in accordance with the laws of vector algebra, 


-we have: 
F, = F,cos% + F,cos3 + F, cos ¥ 
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and the quantity M (if for the sake of simplicity we assume that ¢ is: 
constant) can be written in the form 


M = ail (F, cos + Fy cos 8 + F;, cos Y) ds. 


For reasons which are now obvious the surface integral 


ie cosa + Fy, cos 8 + F, cos Y)de = {{ F,, do, 

sy S 
taken over a definite side of the surface S' is known as flow of a vector 
field F(x, y, z) across the surface S in the direction defined by the chosen 
side of the surface. We have met integrals of this type on many occa- 
sions in the past. For example the surface integral in Ostrogradskij’s 
formula (3) (§ 128) is an integral of this type if we assume (which is, of” 
course, always possible) that P,Q and R are the components Fy, Fy, Fz 
of a vector F in the direction of the coordinate axes; if we also pay 
attention to the fact that the integrand on the left-hand side of” 
formula (3) § 128 represents in this case divergence of the vector F, 
then Ostrogradskij’s formula can be written in the from 


{ff div F dx dy dz = {| F,, ds, 
V S 


which is at the same time very simple and expressive. Hence this. 
formula implies in the vector sense that flow of a vector field from: 
the interior of a closed surface is equal to the integral of divergence 
of this field in a region bounded by the given surface. Also the 
theorem proved at the end of § 128 can be stated as follows: in order 
that flow of the given vector field across an arbitrary closed surface in the given 
region V should be-equal to zero it is necessary and sufficient that divergence of 
this field should be identically zero in this region V. 

4. Circulation in a vector field. Vector of turbulence. Potential field. 
We will now show that Stoke’s formula (§ 129) can be given a simple 
and convenient vector interpretation. On the right-hand side of this . 
formula ((7) § 129) we have the integral 


[ea 56 ip EER GA, 
i 


which, in accordance with § 125, we can represent in the form 


| (P cosa + Qcos 6 + Ros c) da, 
L 


where a, ), c are the angles between the tangent to the curve Z and: 
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the positive directions of the coordinate axes- If we consider the 
vector field F(x, », z) with the components 

Fz =P, Fy =Q,F:= R, (1) 
then the integrand evidently becomes the projection F; of the vector 
F in the direction of the tangent to the curve LZ at the given point 
and our integral can be written in the form 


fra. 
L 
This integral is usually known as ¢ircudation of the vector field F 
around a closed path L; it is evident that F; represents the projectioh 
of the vector F onto the tangent to the curve L in the direction in which 
this contour is described. 
Let us now consider the left-hand side formula (7) § 129. We 


know from formula (4) $ 127 that this left-hand side can be written 
in the form 


OR Ne for or 4 (82 __ oP a 
IG & : cos a+ (5 sz) oo 4 ax ~ Fy) 08 § a 


eee the angles «, 8 and Y are defined as usual (the direction of the 
normal must, of course, correspond to the chosen side of the surface 
S which, in its turn, must coincide with the direction in which the 
contour LZ on the right-hand side of this formula is described). 
Together with the vector field F (x, y, z) with components (1) let us 
now introduce another uniquely defined vector field C (x, y, z) whose 
component functions are 
es oly _ OF, oF ay OF, 
Oy 16g 8 Neg ge ax Oy 

the vector C, which is very important in hydrodynamics, is known as 
vector of turbulence or rotor of the given field F and the set of its values 
as field of turbulence (with respect to the field F). The vector of 
turbulence C is frequently denoted by rot F (“rotor of the vector F’’). 
Hence the last integral can be written in the form 


{{ (C, cos“ + Cycos % + Cz cos Y) do = {| C, ds, 
; s 
where CG, is the projection of the vector of turbulence C=rot F in the 
direction of the normal to the surface S corresponding to the chosen 
side of the surface S. Hence Stoke’s formula can be written as follows: 


{| Cy do =| Fa, 
S L 
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-where the chosen side of the surface S and the direction in which the 
contour L is described coincide in accordance with § 129. Hence 
the vector interpretation of this formula involves the fact that flow of a 
turbulent field C across the given surface S bounded by the contour L is equal to 
the circulation of the given vector field F along this contour (where the direction 
of flowand the direction in which the contour L is described coincide). 


To give an example of the general theorems of the field theory 
‘we shall state in vector terminology the lemma which we have 
‘proved at the end of § 129 by means of Stoke’s formula; if zn a certain 
region V in space the vector field F is such that the corresponding field of 
turbulence does not exist (i.e. rot F = 0 at every point of the region V), 
then the circulation of the field F becomes zero around every closed curve which 
can serve as the contour of a surface situated entirely within the region V. 
The converse theorem is also valid as can be readily seen from the 
Jemmas stated at the end of § 125. 


If for the given vector field F the vector of turbulence rot F 
‘vanishes at every point of a region V in space, then this shows that in 
this region 





OFe OF y OF, oF: Oy _ oF 

ay dx * dz ax * 8Z Oy 
but ‘it follows ‘from the lemmas § 125 that these conditions are 
necessary and sufficient in order that the expression 


Podx+ Fy dy + Fz dz 





‘should be differential of a function U(x, », z), 7 e. a function U should 
‘exist for which 


OU a CU Yn 


ox ” Oy ” Oz a 2) 


Tf this function exists, it is known as potential or potential function of the 
field ‘F and the fieid F itself as potential field. Finally if the relations 
(2) are satisfied, the vector F evidently represents gradient of the 
scalar field defined by the function U. It therefore follows from 
above that potential field, non-turbulent field (t.e. for which the vector of 
turbulence becomes identically zero) and gradient field (F = grad U) 
are equivalent concepts (at least for regions of sufficiently simple 
form). Thus we have for any scalar field U (x, y, z) 


rot grad U = 0. | 


For exercises to § 130 cf. Problem Book by B.P. Demidovich, 
Section VIII, Nos.-436, 438, 439, 452, 468, 483. 


‘CONCLUSION 
Short historical sketch : 
:o 


During the XVII century practical requirments connected with: 
the development of social and economical relationships which, in their 
turn, were influenced by technical progress in all fields of human. 
activity confronted mathematicians with many new problems. A group: 
of problems mainly connected with geometry and mechanics which 
became different from many earlier problems and required entirely 
new methods for solution soon became prominent. Many leading- 
thinkers of that period naturally directed their attention towards 
solution of these problems. Most of the scholars could not clearly 
tell the time when this division of new problems from the old took. 
place. However, we can now see it very clearly: the new problems 
arose in connection with the study of quantities where attention was 
centred not on the values of these quantities at a given moment of | 
the process but on their character of change in the given phenomenon. 


As is usually the case in the development of new fields of 
mathematical sciences, the methods for solving these new problems 
were gradually forthcoming, generally as a result of investigation of” 
individual concrete problems ; however, their common characteristics . 
which form the basis of this scientific branch were recognised and 
explained rather slowly and could only be fully realised after many 
concrete problems were solved. At present we can clearly see that 
many problems revolved around two centres which we now call 
differentiation and integration of functions. In both cases the concept of” 
function was the basis of the newly created science, 7.e. the concept 
of a quantity which changes in strict relation to changes in other 
quantities. Hence from the methodical point of view the require- 
ments for this new science to progress strictly corresponded to the 
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dialectical principles of nature study ; not the momentary values of 
quantities were studied but their process of change ; on the other 
hand, quantities were studied not in isolation but in strict inter- 
dependence. Engels mentioned quite correctly somewhat later that 
motion and dialectics entered mathematics together with the variable 
quantity and became the main object of investigation. 


The main outlines of the new science, for whose development 
most of the outstanding scientists of XVII century worked, only 
became apparent about the end of the century and were expressed 
in the fundamental works by Newton and Leibnitz. These works 
are usually regarded as the origin of differential and integral 
calculus. Newton and Leibnitz, independent of each other and by 
rather different methods, developed, the basis of the new science by 
generalising earlier researches. The great value of the works of 
both scholars is rightly ascribed to the fact that they were the 
first to give deserved prominence to the relationship between in- 
tegration and differentiation of functions (§ 50) which reveals the 
mutually reciprocal character of these two basic operations of mathe- 
matical analysis and thus from that moment onwards, become 
historically, the mainspring for further development of this scientific 
branch. ‘They also introduced infinite series which soon became an 
important investigational tool of mathematical analysis. 


Tk 


From XVIII century onwards differential and integral calculus 
‘began to develop rapidly and were accompanied by the creation of 
other scientific branches within mathematics itself {differential 
equations, calculus of variations and then integral equations, general 
functional analysis, etc.) and the pronounced penetration of the 
amethods of “analysis of infinitely small quantities’? into the ever- 
‘widening circle of applied sciences. We can say without exaggeration 
that during its whole course of development mathematics never knew 
an era when so much was achieved in such a short time and when 
its outlines were radicaily changed and infinitely widened. 


In the fields of differential and integral calculus mean-value 
theorems were proved which, together with the development of 
infinite series, made the expansion of functions into series, i.e. at first 
into power series possible; thus the accurate investigation of these 
series became possible. The methods of integration soon became 
well-known, new transcendental functions created by the process of 
integration were subjected to systematic investigations and a series 
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‘of important functions were defined by means of integrals depend- 
‘ing On parameters (see beginning of chapter XXVI). The laws 
-of differential and integral calculus were progressively applied to the 
‘study of functions of several variables. It is impossible to list the 
names of all leading mathematicians of this period who participated 
‘In this development. However, the names of two great scholars who 
contributed during the first stages of this new era must be noted, wiz. 
Euler and Lagrange—who pointed out many new directions which 
‘proved important in the subsequent development of analysis. The St. 
Petersburg scientist Euler is not only known as the author of a series 
of special studies (‘‘Euler’s substitutions” § 63, “‘Euler’s integrals” 
§ 112, theorem on homogeneous functions § 93, etc.) but also as one 
-of the creators of the theory of differential equations and calculus of 
variations: he also widend and rationalised concept of infinite series 
introduced by Newton and was the first to define a most important 
concept, viz. analytic functions; the works of Euler contain a great 
‘variety of applied problems which he solved by means of the new 
methods. Lagrange discovered the fundamental theory of mean- 
‘value theorems and was first to use them systematically, for example 
in the evaluation of the remainder of Taylor’s series as well as in the 
‘general development of power series; they were also the first to 
‘describe the elements of calculus of variations as an independent 
branch of mathematical analysis by introducing the concept of 
‘variation and establishing rules for variations. However, the most 
outstanding contribution to the new science by Lagrange was the 
creation of “analytic mechanics” which involved systematic construc- 
tion of theoretical mechanics by means of the methods of analysis 
of infinitely small quantities. His was the first systematic work in 
this field although he based it on Euler’s works; his work was 
characterised by such finality that it retains its fundamental impor- 
tance to the present day in spite of the great subsequent developments 


an mechanics. 


Apart from mechanics and sometimes along with it the methods 
of analysis of infinitely small quantities began to penetrate rapidly 
into other branches of mathematics (geometry) and an ever-widening 
circle of applied sciences. Among the applied sciences in which the 
use of the new methods was particularly fruitful were many branches 
of mathematical physics (theory of heat, accoustics, electro-dynamics, 
theory of diffusion and many others) and the mathematical theory 
of probability (Bernoulli, Moivre, Laplace). The use of methods of 
mathematical analysis in many branches of theoretical and applied 
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sciences continued throughout the XIX century; it continues even 
today when applications of differential and integral calculus are so 
wide that every engineer must be familiar with the principles of this 
science in order to satisfy his everyday requirements By studying 
the history of the gradual conquests made by the methods of infinitely 
small quantities we can clearly see the reason behind this victorious 
development. It is undoubtedly due to the fact that this method 
satisfied the requirements of the dialectico-methodical theory of learn- 
ing and created a-mathematical apparatus which was‘able to embrace 
the main outlines of many phenomena in the outside world. 


it 


: We, have thus seen that during the XVIIE century results. 
achieved with the help of the method of infinitely small quantities. 
represent an impressive and unprecedented picture of wealth; 
however, the position was quite different where the logical basis 
of this new science is concerned. The structure of differential and 
integral calculus and its manifold applications went forward so- 
rapidly and with such success that no time was left for revision and. 
improvement of the theory. And here the position was very un-- 
favourable. The logical basis on which this course was constructed: 
was mainly created during the XIX century ; even the elementary: 
theory of limits which we have introduced in chapter 2 and defined: 
more accurately and developed in the subsequent two chapters in. 
order to bring it up to modern levels—even this imperfect theory 
was quite unknown in the XVIII century. 


The situation was very peculiar at times: no fundamental 
concept of analysis was defined with any degree of accuracy ; the: 
question of what was meant by an infinitely small quantity was the: 
subject of endless discussions which were quite useless from a logical 
point of view since in most cases neither side was able to present. 
anything but vague examples which led nowhere. The position was. 
similar with the concept of continuity, differential, derivative and: 
integral. Imagine the difficulty—to teach these concepts to a man: 
who is unfamiliar with the concept of the limit — and you will 
immediately realise that you can give him nothing but descriptions. 
which cannot even be correct*. 


At present we regard the concept of derivative as the main-. 
spring of differential calculus whereas differential is of secondary 


*) We must note, however, that some leading scholars understood certain 
aspects of the new ideas in almost modern sense. 
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importance, for it is defined by the derivative.’ In the XVIII 
century, however, differential was regarded as fundamentally im: 
portant (although in the works of Newton and even more so in the 
works of Euler and Lagrange, concepts are defined more closely to 
the modern point of view). What did these scholars understand ' by 
differential ? If y is a continuous function of x,:then as A «decreases, 
Ay also becomes infinitely small and a definite value of Ay corres- 
ponds to each value of Ax. We must imagine that at the very last 
moment before Ax and Ay vanish, these quantities assume their 
‘ast’? values which arc less than any of their previous values, but 
which are nevertheless not zero. These values were defined as infinitely 
small increments or as differentials of x and yand denoted by dx and dy ; 
their ratio py’ =dy/dx (we can divide since dx is not yet equal to zero !) 
was known as derivative of » with respect to x. Hence, differentials 
were regarded not as variables but as constants and derivative, not as 
a limit of the ratio of variable increments but as a real ratio of two 
increments. Therefore, the general concept of an infinitely small 
quantity assumed the same characteristics :'an infinitely small quantity 
was believed to be the last stage in the decrease of a given quantity, 
i.e. a value which is less than all other values, so that after it only 
zero follows, although it is itself non-zero, i.e. it is a constant which 
cannot decrease further ; therefore, such quantities were also often 
called “indivisibles”. Accordingly, an integral was regarded not a 
limit of sum of an indefinitely increasing number of indefinitely 
decreasing terms, but as the real sum of an indefinite’ number of such 
‘sindivisibles”. For the same reason—the absence of an accurate 
concept of limiting processes—the sum of an infinite series was 
regarded as the result of a real addition of an infinite number of 
terms. It is obvious that this concept of summation of series, made it 
impossible to define convergence with any degree of accuracy; the 
irresponsible operation with series whose convergence could not be 
established, was one of the main faults of this mathematical era which 
frequently led to mistakes and paradoxical results. 


We can now clearly see that these points of view could not be 
preserved, since every attempted logical formulation revealed logical 
contradictions. However, even.mathematiciansof the XVIII century, 
at least some of them, clearly understood the faults of the theore- 
tical basis on which the new science was constructed, but, unlike us, 
they were unable to replace it by something better. Works were 
published from time to time in which the currently accepted logical 
fundamentals of mathematical analysis were subjected to severe 
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criticism and sometimes even to ridicule. However, the real victories 
of this new science were so numerous and so significant that all 
doubts of this kind were unable to stop the powerful creative efforts 
of the builders of the new structure, while revision and improvement 
of the theoretical basis was left for a later period. D’ Alembert’s 
slogan: “Go forward and you will be reassured later”’ is character- 
istic of the mood of these times. 


IV 


This assurance, 1n fact, came but not until the XTX century wien 
most essential problems of Analysis and its main applications had 
time to ripen and be solved. It was now possible to slacken the pace 
and devote greater attention to the revision of fundamentals; on the 
other hand, the development of the new theory stimulated critical 
tendencies, as is frequently the case, and made the position existing 
in the logical aspects of analysis quite insufferable. 


In the twenties of the XIX century works were published 
(first to appear was Cauchy’s ‘Course of Analysis”) in which 
mathematical analysis was constructed on the new basis, i.e. on the 
theory of limiting process in its modern sense. Concepts like infi- 
nitely small quantities, continuity, differential and integral were al- 
ready clearly defined; the sum of an infinite series was now treated 
as limit of its partial sums and not as a result of addition of an infi- 
nite number of terms; hence, an accurate definition of. convergence 
became possible and use of divergent series was strictly limited. 
The proof of existence of integrals was given and differential equa- 
tions were solved for the first time. As usual in such cases recons- 
truction of fundamentals cannot be ascribed to Cauchy alone; the 
time was now ripe for these new ideas which formed in the right 
direction in many leading brains of this era. Several years before 
the publication of Cauchy’s “‘Course’’, the Czechoslovakian philoso- 
pher-methematician Bolzano obtained a series of results which 
anticipated many ideas found in Gauchy’s book, and also contained 
modern definitions of continuity and the first example of a continuous 
function without Cerivatives. Simultaneously with Cauchy, Abel 
deduced fundamental results which led to the creation of a strict 
theory of infinite series. Nevertheless, Cauchy’s ‘‘Course” is un- 
doubtedly the first work of this kind where an extensive thesis on 
analysis of infinitely small quantities based on logical considerations 
is given ; this book served for a long time as a model for other works 
devoted to the same subject. However, in the next decade, Cauchy’s 
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conceptions had to be defined rather more accurately and some 
corrections had to be made; for example, Cauchy failed to define 
the concept of uniform convergence of a series; he proved the 
theorem (which we now know to be incorrect) that the sum ofacon- 
vergent series of functions which are continuous in an interval is also 
always continuous in that interval. Also, the concept of limit whose 
denifition remained in principle unchanged to this day had to be de- 
fined more exactly ; we did this in § 14, § 15 and used it subsequent- 
ly throughout this book. 


The greatest event in further historical development of the 
logical basis of mathematical analysis after Cauchy’s era can undou- 
btedly be ascribed to the advances in the general theory of real num- 
bers which evolved in the seventies of the XIX century. The necessity 
for this theory was felt as acutely at this time as the necessity for a 
clear definition of infinitely small quantities was felt at the beginning 
of that century. We have explained in chapter 4 why mathematical 
analysis can have no firm basis without the theory of continuum; we 
have given there one of the simplest methods for evolving this theory. 
In the seventies of the last century, several such theories appeared 
simultaneously ; they were all quite satisfactory, each had its own 
advantages and was equivalent to one another in the formal logical 
sense. Weierstrass, Dedekind and Canter must be mentioned in con- 
nection with these theories. 


The theory of real numbers cannot, of course, be regarded as 
part of mathematical analysis. It belongs to the theory of numbers 
and the theory of sets. However, numbers are the medium which 
originate and develop all concepts of mathematical analysis and there- 
fore a thorough theoretical basis of mathematical analysis could not 
develop until the properties of this medium were studied to the end. 
Hence, only after the theory of continuum was finally created, mathe- 


matical analysis reached its present state. 


Vv 


It is, of course, obvious that apart from the revision and im- 
provement of fundamentals the structure of mathematical analysis 
continued to develop as it does to the present day. During the first 
half of the XUX century the attention of scholars was strongly attrac- 
ted by integral calculus. Thus integreability of elementary functions, 
new transcendental functions defined as primitives of elementary (in 
particular algebraic) functions or by means of integrals depending on 
parameters, the general theory of integrals of several dimensions 
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“(multiple) and - none other: problem: were subjected to strict 
‘studies. |": 


However, from the beginning of the last century, the centre of 
gravity of scientific interests of analysts became progressively displaced 
towards higher. sections of analysis, first of all the theory of differen- 
tial equations—a problem which to this day occupies a central posi- 
tion among | analytical problems. At the end of the last century, 
another problem was added to it, viz., the theory of integral and 
integro-differential equations ; this subject became immediately 
popular‘mainly because of its numerous practical applications. Finally, 
calculus of variations which developed systematically from the begin- 
ning of the XVIII century onwards was, in the course of the last few 
decades, regarded as a particular problem of a new and important 
scientific branch, vz., functional analysis whose general development 
continues to attract more and more attention. 


"Hence, ifwe assume that mathematical analysis covers not only 
differential and integral calculus but also the whole set of the newly- 
created higher sections of the analytical science, then the horizons of 
this science widen greatly, and it is impossible to foresee the time when 
its problems may become exhausted; history. tells us that before one 
circle of problems of mathematical analysis is completely solved many 
other problems arise which demand an immediate solution. 


VI 


From the XIX century onwards Russian mathematicians partici- 
pated ini the ‘development of mathematical analysis—to begin with, 
individual scholars directed attention towards this field and later they 
were joined by powerful mathematical schools. ‘The contribution by 
our scholars to this science during the XIX and the first half of the XX 
centuries is so significant that it must undoubtedly be considered sepa- 
rately, particularly since the contributions by Russian scholars in this 
field, apart from their great scientific value, are characterised by a 


special approach which differ considerably from that of foreign 
scholars. | 


i ny ' 

-It is eal known .that our’ great ecomeny specialist N. I. 
ieee, paid almost no attention to the problems of mathe-. 
matical analysis; it is therefore more significant that he expressed’ 
views. whose depth and insight beats the views held by specialists of 
this era. Thus, the: modern definition .of functional dependence 
which is usually connected with the name of Dirichlet and arose as a. 
result of the victory of:the real, concrete approach over the formalistic 
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approach (cf. § 4) was expressed several years earlier and formu- 
lated with great accuracy by Lobachevskij*; he clearly emphasizes 
that for functional dependence of y on x it is only necessary that 
a definite value of y should correspond to every value of x regardless 


of the way in which this relationship is given. And this is also the essence 
of Dirichlet’s definition. 


In this course we have met twice the name of the outstanding 
Russian mathematician M. V. Ostrogradskij. Aapart from developing 
a remarkable method for integrating rational functions (§ 61) and 
the famous formula which expresses a triple integral in a three- 
dimensional region in terms of a double integral over the surface 
of this region**, Ostrogradskij also deduced several other results 
which are of fundamental importance in integral calculus. Thus he 
was also the first to prove the formulae for transformation of vari- 
ables in multiple integrals and explain the part played in such trans- 
formations by the so-called ‘ ‘functional determinants” or “Jacobians”’ 
(this name is derived from the surname of the German mathematician 
Jacobi who studied the properties of these determinants after they 
were discovered by Ostrogradskij; the latter unfortunately failed to 
publish them ***). 


Ostrogradskij also made important investigations in analytical 
mechanics and calculus of variations. His works (apart from the 
fields mentioned above, he was also interested in ballistics, mechanics 
of heavenly bodies, theory of probability, theory ofalgebraic functions, 
etc.) are characterised .by his deep interest in apphed sciences and 
his attempts to place mathematical sciences on as wide a basis as 
possible, to express all problems in the most general form and then 
solve them strictly and accurately on their own merits. 


Around the middle of the XIX century, works by ‘the greatest 
Russian analyst P.L. Chebyshev began to appear. Chebyshev 
belonged to the school of mathematicians who succeeded in working 
with equal success and interest in many branches of mathematics. 
He investigated problems of integral calculus, approximation of 
functions in terms of polynomials with interpolations of various kinds, 
theory of numbers, theory of probability and theory of mechanisms; 





* See B. V. Gnedenko, “Sketches from the History of Mathematics in Russia,” 
Gostekhizdat, 1946, p. 96. 

** M. V. Ostrogradskij solved this problem for space of any dimensions, 7.¢., 
he established a general formula which replaced evaluation of an integral of 
multiplicity n by an integral of multiplicity (n -- 1). 

**#* In this text we have called them “Ostrogradskij’s determinants”. 
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and almost in every field he succeeded in developing new methods 
whose use continued for many years to be a model for his pupils and 
successors. His theories on approximation of functions in terms of 
polynomials continued to develop until at present they form a 
separate scientific branch—‘‘constructive theory of functions’. His 
works on the theory of probability have completely transformed the 
outlook of this science; he was the first to state its general problems 
and develop methods for their solution. In the theory of numbers 
Chebyshev was the first to develop the theory of distribution of simple 
numbers into a natural series which was left at a standstill for a long 
time ; on the other hand, he laid foundations for solution of hetero- 
geneous problems in the theory of diophantine approximations; he 
uncovered such a huge field of activity to succeeding generations that 
it has not yet been exhausted. Chebyshev’s works on the theory of 
mechanisms have not lost their importance to this day, either in 
theory or in practice. In the field of mathematical analysis in which 
we are interested Chebyshev made a ‘series of investigations in 
integreability of elementary functions which were difficult to inte- 
grate, and, in particular, he established the famous theorem on 
integreability of binomial differentials (§ 64). Chebyshev also 
published several important works on integration of rational func- 
tions, approximate evaluation of integrals, interpolation and the 
so-called ‘problem of moments’’. 


The scientific approach in Chebyshev’s works is mainly charac- . 
trised by the tendency to solve practical problems. In his article 
“Drawing of Geographical Maps” Chebyshev wrote: ‘The relation- 
ship between theory and practice gives the most desirable results and 
is to the advantage of both practice and theory; science itself develops 
under its influence; it reveals new subjects for investigation or new 
sides of well-known subjects”. The example which best illustrates 
Chebyshev’s point of view is that he evolved the general theory of 
approximating functions in terms of ploynomials as a result of solving 
one concrete problem in the theory of mechanisms. However, this 
example also describes another side of Chebyshev’s scicntific creat- 
iveness. Although strictly adhering to practical requirements, he 
never tried to solve one isolated case. On the contrary, he always 
tried to place such problems on the widest possible footing and deduce 
mathematical theories which would embrace the greatest number of 
similar problems. ‘The history of development of mathematics shows 
that solution of parctical problems is most useful for the development 
of the mathematical science as a whole. 
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Chebyshev formed the first large mathematical school in Russia 
which soon gained world-wide importance. Chebyshev’s brilliant 
pupils (Zolotariev, Liapunov, Markov and others) partly continued 
his investigations, but they also tried to conquer new fields. In 
the history of mathematical analysis and in its physical applications, 
the remarkable work of A.M. Liapunov is of the greatest importance. 
Liapunov created a. new trend in analysis which was mainly prompted 
by problems of mechanics and mathematical physics but which 
soon gained an independent mathematical meaning. The main 
objects of his investigations were equilibrium conditions of fluid 
bodies on the one hand (important in the study of heavenly bodies) 
and, on the other hand, the problems of stability and instability 
under equilibrium conditions and movement of mechanical systems. 
During this period (at the junction of the XIX and XX centuries), 
these problems were of universal interest; Liapunov also worked in 
conjunction with the famous French scientist Poincare who was also 
interested in these problems. It is interesting to note the different 
approach of these two scientists, since they are characteristic of the 
Russian school as a whole as compared to many West European 
schools. In solving physical problems, Poincare often did not permit 
strictly accurate assumptions and, realising this, he maintained that 
“you cannot require the same strictness in mechanics.as in pure 
analysis”. But Liapunov solved the same type of problems with 
absolute accuracy and said * ‘‘we must not use doubtful arguments 
no matter how soon they give us solution of the given problem, 
regardlesss of whether it is a problem of mechanics or physics, provid- 
ed it is stated quite definitely from the analytical point of view. It 
thus becomes a problem of pure analysis and should be treated as 
such”. It is therefore clear that because of this difference in treat- 
ment Liapunov’s results have greater finality and are more funda- 
mental in character than the achievements by the french scientist. 


Liapunov was the first to prove a very important theorem on 
closed trigonometrical orthogonal systems (§ 83). In the appli- 
cations of analysis he was the first to prove the so-called ‘‘central 
limit theorem”? in the theory of probability which is still of great 
importance in this branch of mathematics. He carried out his 
proof with the help of a new original method whose general outlines 
were worked out much later and proved to be one of the most essen- 
tial methods in the analytical theory of probability. 





“¢.f. Notes of thc Academy of Scicnces, Physico-mathcmatical scction, 8th 
series 1905, vol. 17, No. 38, pp. 1-32. 
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Apart from Chebyshev’s school, the scientific creativeness of 
S. V. Kovalevskaja must be mentioned. Among her works, two are 
of fundamental importance; one of them deals with the theory of 
differential equations and the other with the mechanical problem of 
movement of a solid body with a stationary point. Kovalevskaja 
worked mostly abroad, since as a woman she could not find suitable 
conditions for her work in Imperial Russia. Nevertheless, all her 
works have the typical characteristics of the Russian mathematical 
school. She reveals the same strict concern for her subject, the great 
interest in applied sciences and the same width and generality in 
defining the problems which she solved with an absolute accuracy 
of the technico-mathematical arguments involved ; this isso character- 
istic of Chebyshev and of all his pupils that it gave the Russian 
mathematical school its peculiar monumental style which none of the 
West European schools could claim. 


The next generation of Chebyshev’s school worked partly in 
Soviet times. To this generation belong such leading representatives 
of mathematical analysis as V. A. Steklov and S. N. Bernstein who 
greatly contributed to the analytical treasury in the field of differen- 
tial equations, constructive theory of functions and in many other 
branches as well as in applied sciences, viz., mathematical physics 
and theory of probability. 


The genera growth of sciences in the USSR after the Great 
October Socialist Revolution raised the work on mathematical analysis 
both in quality and quantity to a higher level. Science, and therefore 
also mathematical sciences, now has many more workers than in pre- 
revolution days; on the other hand, the right and competent plann- 
ing of research work, scientific establishments and scientific publica- 
tions as well as thorough, planned and highly authoritative education 
of the forthcoming generation assures improved quality of scientific 
findings. The Soviet team of workers on mathematical analysis 
under the leadership of our academicians (S. N. Bernstein, M. V. 
Keldysh, N. M. Krylov, M.A Lavrentiev, I. G. Petrovskij, V. I. 
Smirnov, S. L. Sobolev) already have to their credit a long string 
of first-rate achievements. Faithful to the famous traditions of 
Russian mathematics and inspired by the desire to give all their 
strength to their country and the Soviet people, they assuredly go 
forward towards new conquests. 
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